2026-02-20T02:19:50.492 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T02:19:50.509 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T02:19:50.588 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394 branch: wip-jcollin-testing-20260218.004834-squid description: fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} email: jcollin@redhat.com first_in_suite: false flavor: default job_id: '55394' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-jcollin-testing-20260218.004834-squid ceph: cluster-conf: mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: debug ms: 1 debug osd: 20 osd op complaint time: 180 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - MGR_MODULE_ERROR - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - pg .* is stuck peering sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-jcollin-testing-20260218.004834-squid sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 owner: scheduled_jcollin@soko04.front.sepia.ceph.com priority: 200 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - host.b - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 5467 sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 sleep_before_teardown: 0 subset: 663/2048 suite: fs suite_branch: wip-jcollin-testing-20260218.004834-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 targets: trial098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJV5CMnG3IqoBCL9WQuHUg5FVQBcumPIiUaOL42uih+DkNYjOkHyz8q2XTlBmPx6aJYTjxsQW5nYu2CfkrAnEDs= trial106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPzYDqxDsiT0BuK3XyHgueXSB6xomyupRRUS2+JUmaRV2VDHc3kajB6ZRuOJZsMQyfEzy0+psS6uPfWzx8H4/g= tasks: - install: null - cephadm: roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create foo - ceph fs volume create bar - fs.ready: timeout: 300 - ceph-fuse: client.0: cephfs_name: foo - ceph-fuse: client.1: cephfs_name: bar - workunit: clients: all: - suites/dbench.sh - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-18_03:11:55 tube: trial user: jcollin verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T02:19:50.588 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa; will attempt to use it 2026-02-20T02:19:50.589 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa/tasks 2026-02-20T02:19:50.589 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T02:19:50.591 INFO:teuthology.task.internal:Checking packages... 2026-02-20T02:19:50.591 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03' 2026-02-20T02:19:50.591 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T02:19:50.591 INFO:teuthology.packaging:ref: None 2026-02-20T02:19:50.591 INFO:teuthology.packaging:tag: None 2026-02-20T02:19:50.591 INFO:teuthology.packaging:branch: wip-jcollin-testing-20260218.004834-squid 2026-02-20T02:19:50.591 INFO:teuthology.packaging:sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:19:50.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-jcollin-testing-20260218.004834-squid 2026-02-20T02:19:50.708 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-700.gf4ef35d9 2026-02-20T02:19:50.710 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T02:19:50.722 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T02:19:50.722 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T02:19:50.736 INFO:teuthology.task.internal:Saving configuration 2026-02-20T02:19:50.749 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T02:19:50.761 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T02:19:50.838 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial098.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 02:16:23.050497', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJV5CMnG3IqoBCL9WQuHUg5FVQBcumPIiUaOL42uih+DkNYjOkHyz8q2XTlBmPx6aJYTjxsQW5nYu2CfkrAnEDs='} 2026-02-20T02:19:50.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial106.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 02:16:23.049872', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPzYDqxDsiT0BuK3XyHgueXSB6xomyupRRUS2+JUmaRV2VDHc3kajB6ZRuOJZsMQyfEzy0+psS6uPfWzx8H4/g='} 2026-02-20T02:19:50.893 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T02:19:50.906 INFO:teuthology.task.internal:roles: ubuntu@trial098.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-20T02:19:50.906 INFO:teuthology.task.internal:roles: ubuntu@trial106.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2026-02-20T02:19:50.906 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T02:19:51.039 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x73e9aecf77e0>, signals=[15]) 2026-02-20T02:19:51.039 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T02:19:51.056 INFO:teuthology.task.internal:Opening connections... 2026-02-20T02:19:51.056 DEBUG:teuthology.task.internal:connecting to ubuntu@trial098.front.sepia.ceph.com 2026-02-20T02:19:51.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T02:19:51.120 DEBUG:teuthology.task.internal:connecting to ubuntu@trial106.front.sepia.ceph.com 2026-02-20T02:19:51.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T02:19:51.181 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T02:19:51.193 DEBUG:teuthology.orchestra.run.trial098:> uname -m 2026-02-20T02:19:51.209 INFO:teuthology.orchestra.run.trial098.stdout:x86_64 2026-02-20T02:19:51.209 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:NAME="CentOS Stream" 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="9" 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:ID="centos" 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel fedora" 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="9" 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el9" 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;31" 2026-02-20T02:19:51.265 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon" 2026-02-20T02:19:51.266 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T02:19:51.266 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://centos.org/" 2026-02-20T02:19:51.266 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T02:19:51.266 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T02:19:51.266 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T02:19:51.266 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server 2026-02-20T02:19:51.412 DEBUG:teuthology.orchestra.run.trial106:> uname -m 2026-02-20T02:19:51.428 INFO:teuthology.orchestra.run.trial106.stdout:x86_64 2026-02-20T02:19:51.428 DEBUG:teuthology.orchestra.run.trial106:> cat /etc/os-release 2026-02-20T02:19:51.485 INFO:teuthology.orchestra.run.trial106.stdout:NAME="CentOS Stream" 2026-02-20T02:19:51.485 INFO:teuthology.orchestra.run.trial106.stdout:VERSION="9" 2026-02-20T02:19:51.485 INFO:teuthology.orchestra.run.trial106.stdout:ID="centos" 2026-02-20T02:19:51.485 INFO:teuthology.orchestra.run.trial106.stdout:ID_LIKE="rhel fedora" 2026-02-20T02:19:51.485 INFO:teuthology.orchestra.run.trial106.stdout:VERSION_ID="9" 2026-02-20T02:19:51.485 INFO:teuthology.orchestra.run.trial106.stdout:PLATFORM_ID="platform:el9" 2026-02-20T02:19:51.486 INFO:teuthology.orchestra.run.trial106.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T02:19:51.486 INFO:teuthology.orchestra.run.trial106.stdout:ANSI_COLOR="0;31" 2026-02-20T02:19:51.486 INFO:teuthology.orchestra.run.trial106.stdout:LOGO="fedora-logo-icon" 2026-02-20T02:19:51.486 INFO:teuthology.orchestra.run.trial106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T02:19:51.486 INFO:teuthology.orchestra.run.trial106.stdout:HOME_URL="https://centos.org/" 2026-02-20T02:19:51.486 INFO:teuthology.orchestra.run.trial106.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T02:19:51.486 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T02:19:51.486 INFO:teuthology.orchestra.run.trial106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T02:19:51.487 INFO:teuthology.lock.ops:Updating trial106.front.sepia.ceph.com on lock server 2026-02-20T02:19:51.586 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T02:19:51.600 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T02:19:51.611 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T02:19:51.611 DEBUG:teuthology.orchestra.run.trial098:> test '!' -e /home/ubuntu/cephtest 2026-02-20T02:19:51.613 DEBUG:teuthology.orchestra.run.trial106:> test '!' -e /home/ubuntu/cephtest 2026-02-20T02:19:51.628 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T02:19:51.639 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T02:19:51.639 DEBUG:teuthology.orchestra.run.trial098:> test -z $(ls -A /var/lib/ceph) 2026-02-20T02:19:51.668 DEBUG:teuthology.orchestra.run.trial106:> test -z $(ls -A /var/lib/ceph) 2026-02-20T02:19:51.685 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T02:19:51.815 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T02:19:51.835 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T02:19:51.835 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T02:19:51.835 DEBUG:teuthology.orchestra.run.trial098:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T02:19:51.835 DEBUG:teuthology.orchestra.run.trial106:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T02:19:51.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T02:19:51.850 DEBUG:teuthology.orchestra.run.trial098:> uname -r 2026-02-20T02:19:51.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T02:19:51.850 DEBUG:teuthology.orchestra.run.trial106:> uname -r 2026-02-20T02:19:51.905 INFO:teuthology.orchestra.run.trial098.stdout:5.14.0-681.el9.x86_64 2026-02-20T02:19:51.905 INFO:teuthology.task.kernel:Running kernel on trial098: 5.14.0-681.el9.x86_64 2026-02-20T02:19:51.905 DEBUG:teuthology.orchestra.run.trial098:> sudo yum install -y kernel 2026-02-20T02:19:51.906 INFO:teuthology.orchestra.run.trial106.stdout:5.14.0-681.el9.x86_64 2026-02-20T02:19:51.906 INFO:teuthology.task.kernel:Running kernel on trial106: 5.14.0-681.el9.x86_64 2026-02-20T02:19:51.906 DEBUG:teuthology.orchestra.run.trial106:> sudo yum install -y kernel 2026-02-20T02:19:53.149 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-20T02:19:53.970 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.9 MB 00:01 2026-02-20T02:19:56.228 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T02:19:56.943 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-20T02:20:00.409 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 7.8 MB 00:00 2026-02-20T02:20:01.452 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 20 kB 00:00 2026-02-20T02:20:02.564 INFO:teuthology.orchestra.run.trial106.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-20T02:20:05.844 INFO:teuthology.orchestra.run.trial106.stdout:lab-extras 784 kB/s | 50 kB 00:00 2026-02-20T02:20:06.781 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - CRB 969 kB/s | 7.8 MB 00:08 2026-02-20T02:20:06.854 INFO:teuthology.orchestra.run.trial106.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T02:20:06.854 INFO:teuthology.orchestra.run.trial106.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T02:20:06.873 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:20:06.873 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:20:06.873 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:20:06.898 DEBUG:teuthology.orchestra.run.trial106:> echo no | sudo yum reinstall kernel || true 2026-02-20T02:20:07.204 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 02:20:05 AM UTC. 2026-02-20T02:20:07.284 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:20:07.285 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:20:07.285 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-20T02:20:07.285 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:20:07.285 INFO:teuthology.orchestra.run.trial106.stdout:Reinstalling: 2026-02-20T02:20:07.285 INFO:teuthology.orchestra.run.trial106.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T02:20:07.285 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:20:07.285 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:20:07.286 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:20:07.286 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:20:07.286 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 803 k 2026-02-20T02:20:07.286 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 0 2026-02-20T02:20:07.286 INFO:teuthology.orchestra.run.trial106.stderr:Operation aborted. 2026-02-20T02:20:07.305 INFO:teuthology.orchestra.run.trial106.stdout:Is this ok [y/N]: 2026-02-20T02:20:07.305 DEBUG:teuthology.orchestra.run.trial106:> sudo yum reinstall -y kernel || true 2026-02-20T02:20:07.604 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 02:20:05 AM UTC. 2026-02-20T02:20:07.684 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout:Reinstalling: 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 803 k 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 0 2026-02-20T02:20:07.685 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:20:08.590 INFO:teuthology.orchestra.run.trial106.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-20T02:20:08.590 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:20:08.590 INFO:teuthology.orchestra.run.trial106.stdout:Total 888 kB/s | 803 kB 00:00 2026-02-20T02:20:08.600 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:20:08.633 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:20:08.633 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:20:08.638 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:20:08.638 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:20:08.662 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:20:08.666 INFO:teuthology.orchestra.run.trial106.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T02:20:08.666 INFO:teuthology.orchestra.run.trial106.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T02:20:08.774 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T02:20:08.774 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T02:20:08.829 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T02:20:08.829 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:20:08.829 INFO:teuthology.orchestra.run.trial106.stdout:Reinstalled: 2026-02-20T02:20:08.829 INFO:teuthology.orchestra.run.trial106.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T02:20:08.829 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:20:08.829 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:20:08.856 DEBUG:teuthology.orchestra.run.trial106:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T02:20:08.880 INFO:teuthology.orchestra.run.trial106.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T02:20:08.881 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T02:20:08.881 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T02:20:08.881 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-20T02:20:08.881 DEBUG:teuthology.orchestra.run.trial106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T02:20:08.945 INFO:teuthology.orchestra.run.trial106.stdout:ttyS1 2026-02-20T02:20:08.973 DEBUG:teuthology.parallel:result is None 2026-02-20T02:20:36.724 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - Extras packages 706 B/s | 20 kB 00:29 2026-02-20T02:20:37.237 INFO:teuthology.orchestra.run.trial098.stdout:Extra Packages for Enterprise Linux 45 MB/s | 20 MB 00:00 2026-02-20T02:20:40.392 INFO:teuthology.orchestra.run.trial098.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-20T02:20:41.408 INFO:teuthology.orchestra.run.trial098.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T02:20:41.408 INFO:teuthology.orchestra.run.trial098.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T02:20:41.427 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:20:41.428 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:20:41.428 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:20:41.450 DEBUG:teuthology.orchestra.run.trial098:> echo no | sudo yum reinstall kernel || true 2026-02-20T02:20:41.792 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 02:20:40 AM UTC. 2026-02-20T02:20:41.873 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:20:41.874 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:20:41.874 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-20T02:20:41.874 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:20:41.874 INFO:teuthology.orchestra.run.trial098.stdout:Reinstalling: 2026-02-20T02:20:41.874 INFO:teuthology.orchestra.run.trial098.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T02:20:41.875 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:20:41.875 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:20:41.875 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:20:41.875 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:20:41.875 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 803 k 2026-02-20T02:20:41.875 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 0 2026-02-20T02:20:41.875 INFO:teuthology.orchestra.run.trial098.stderr:Operation aborted. 2026-02-20T02:20:41.895 INFO:teuthology.orchestra.run.trial098.stdout:Is this ok [y/N]: 2026-02-20T02:20:41.895 DEBUG:teuthology.orchestra.run.trial098:> sudo yum reinstall -y kernel || true 2026-02-20T02:20:42.196 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 02:20:40 AM UTC. 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout:Reinstalling: 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:20:42.277 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:20:42.278 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:20:42.278 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 803 k 2026-02-20T02:20:42.278 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 0 2026-02-20T02:20:42.278 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:20:42.615 INFO:teuthology.orchestra.run.trial098.stdout:kernel-5.14.0-681.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2026-02-20T02:20:42.615 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:20:42.615 INFO:teuthology.orchestra.run.trial098.stdout:Total 2.3 MB/s | 803 kB 00:00 2026-02-20T02:20:42.626 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:20:42.663 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:20:42.663 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:20:42.667 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:20:42.668 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:20:42.692 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:20:42.695 INFO:teuthology.orchestra.run.trial098.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T02:20:42.696 INFO:teuthology.orchestra.run.trial098.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T02:20:42.788 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T02:20:42.788 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T02:20:42.839 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T02:20:42.839 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:20:42.839 INFO:teuthology.orchestra.run.trial098.stdout:Reinstalled: 2026-02-20T02:20:42.840 INFO:teuthology.orchestra.run.trial098.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T02:20:42.840 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:20:42.840 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:20:42.867 DEBUG:teuthology.orchestra.run.trial098:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T02:20:42.890 INFO:teuthology.orchestra.run.trial098.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T02:20:42.891 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T02:20:42.891 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T02:20:42.891 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-20T02:20:42.892 DEBUG:teuthology.orchestra.run.trial098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T02:20:42.955 INFO:teuthology.orchestra.run.trial098.stdout:ttyS1 2026-02-20T02:20:42.987 DEBUG:teuthology.parallel:result is None 2026-02-20T02:20:42.987 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T02:20:42.994 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T02:20:42.994 DEBUG:teuthology.orchestra.run.trial098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T02:20:43.029 DEBUG:teuthology.orchestra.run.trial106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T02:20:43.048 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T02:20:43.060 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T02:20:43.073 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T02:20:43.073 DEBUG:teuthology.orchestra.run.trial098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T02:20:43.085 DEBUG:teuthology.orchestra.run.trial106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T02:20:43.111 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T02:20:43.124 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T02:20:43.124 DEBUG:teuthology.orchestra.run.trial098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T02:20:43.143 DEBUG:teuthology.orchestra.run.trial106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T02:20:43.166 INFO:teuthology.orchestra.run.trial098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T02:20:43.169 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T02:20:43.175 INFO:teuthology.orchestra.run.trial098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T02:20:43.177 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T02:20:43.178 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T02:20:43.193 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T02:20:43.193 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T02:20:43.219 DEBUG:teuthology.orchestra.run.trial106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T02:20:43.246 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T02:20:43.266 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T02:20:43.266 DEBUG:teuthology.orchestra.run.trial098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T02:20:43.285 DEBUG:teuthology.orchestra.run.trial106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T02:20:43.302 DEBUG:teuthology.orchestra.run.trial098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T02:20:43.426 DEBUG:teuthology.orchestra.run.trial098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T02:20:43.451 DEBUG:teuthology.orchestra.run.trial098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T02:20:43.594 DEBUG:teuthology.orchestra.run.trial098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T02:20:43.620 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:20:43.620 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T02:20:43.684 DEBUG:teuthology.orchestra.run.trial106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T02:20:43.795 DEBUG:teuthology.orchestra.run.trial106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T02:20:43.821 DEBUG:teuthology.orchestra.run.trial106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T02:20:43.976 DEBUG:teuthology.orchestra.run.trial106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T02:20:44.001 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:20:44.001 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T02:20:44.065 DEBUG:teuthology.orchestra.run.trial098:> sudo service rsyslog restart 2026-02-20T02:20:44.068 DEBUG:teuthology.orchestra.run.trial106:> sudo service rsyslog restart 2026-02-20T02:20:44.095 INFO:teuthology.orchestra.run.trial098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T02:20:44.133 INFO:teuthology.orchestra.run.trial106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T02:20:44.643 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T02:20:44.657 INFO:teuthology.task.internal:Starting timer... 2026-02-20T02:20:44.657 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T02:20:44.679 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T02:20:44.697 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-20T02:20:44.698 DEBUG:teuthology.orchestra.run.trial098:> sudo service auditd rotate 2026-02-20T02:20:44.728 INFO:teuthology.orchestra.run.trial098.stdout:Rotating logs: 2026-02-20T02:20:44.729 DEBUG:teuthology.orchestra.run.trial106:> sudo service auditd rotate 2026-02-20T02:20:44.760 INFO:teuthology.orchestra.run.trial106.stdout:Rotating logs: 2026-02-20T02:20:44.761 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T02:20:44.761 DEBUG:teuthology.orchestra.run.trial098:> /usr/sbin/getenforce 2026-02-20T02:20:44.785 INFO:teuthology.orchestra.run.trial098.stdout:Permissive 2026-02-20T02:20:44.785 DEBUG:teuthology.orchestra.run.trial106:> /usr/sbin/getenforce 2026-02-20T02:20:44.817 INFO:teuthology.orchestra.run.trial106.stdout:Permissive 2026-02-20T02:20:44.817 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial098.front.sepia.ceph.com': 'permissive', 'ubuntu@trial106.front.sepia.ceph.com': 'permissive'} 2026-02-20T02:20:44.817 DEBUG:teuthology.orchestra.run.trial098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T02:20:44.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T02:20:44.850 DEBUG:teuthology.orchestra.run.trial106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T02:20:44.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T02:20:44.881 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T02:20:44.881 DEBUG:teuthology.orchestra.run.trial098:> sudo /usr/sbin/setenforce permissive 2026-02-20T02:20:44.913 DEBUG:teuthology.orchestra.run.trial106:> sudo /usr/sbin/setenforce permissive 2026-02-20T02:20:44.947 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T02:20:44.963 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T02:20:44.974 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T02:20:44.976 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial098.front.sepia.ceph.com,trial106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T02:23:38.062 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial098.front.sepia.ceph.com'), Remote(name='ubuntu@trial106.front.sepia.ceph.com')] 2026-02-20T02:23:38.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-20T02:23:38.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T02:23:38.177 DEBUG:teuthology.orchestra.run.trial098:> true 2026-02-20T02:23:38.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-20T02:23:38.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-20T02:23:38.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T02:23:38.315 DEBUG:teuthology.orchestra.run.trial106:> true 2026-02-20T02:23:38.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial106.front.sepia.ceph.com' 2026-02-20T02:23:38.387 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T02:23:38.401 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T02:23:38.401 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T02:23:38.402 DEBUG:teuthology.orchestra.run.trial098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T02:23:38.404 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T02:23:38.404 DEBUG:teuthology.orchestra.run.trial106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T02:23:38.430 INFO:teuthology.orchestra.run.trial098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T02:23:38.442 INFO:teuthology.orchestra.run.trial098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T02:23:38.454 INFO:teuthology.orchestra.run.trial106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T02:23:38.464 INFO:teuthology.orchestra.run.trial098.stderr:sudo: ntpd: command not found 2026-02-20T02:23:38.467 INFO:teuthology.orchestra.run.trial106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T02:23:38.473 INFO:teuthology.orchestra.run.trial098.stdout:506 Cannot talk to daemon 2026-02-20T02:23:38.485 INFO:teuthology.orchestra.run.trial098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T02:23:38.486 INFO:teuthology.orchestra.run.trial106.stderr:sudo: ntpd: command not found 2026-02-20T02:23:38.496 INFO:teuthology.orchestra.run.trial106.stdout:506 Cannot talk to daemon 2026-02-20T02:23:38.497 INFO:teuthology.orchestra.run.trial098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T02:23:38.508 INFO:teuthology.orchestra.run.trial106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T02:23:38.519 INFO:teuthology.orchestra.run.trial106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T02:23:38.546 INFO:teuthology.orchestra.run.trial098.stderr:bash: line 1: ntpq: command not found 2026-02-20T02:23:38.547 INFO:teuthology.orchestra.run.trial098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T02:23:38.548 INFO:teuthology.orchestra.run.trial098.stdout:=============================================================================== 2026-02-20T02:23:38.564 INFO:teuthology.orchestra.run.trial106.stderr:bash: line 1: ntpq: command not found 2026-02-20T02:23:38.578 INFO:teuthology.orchestra.run.trial106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T02:23:38.578 INFO:teuthology.orchestra.run.trial106.stdout:=============================================================================== 2026-02-20T02:23:38.579 INFO:teuthology.orchestra.run.trial106.stdout:^? 44.190.5.123 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T02:23:38.579 INFO:teuthology.orchestra.run.trial106.stdout:^? 149.28.200.179.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T02:23:38.580 INFO:teuthology.run_tasks:Running task install... 2026-02-20T02:23:38.593 DEBUG:teuthology.task.install:project ceph 2026-02-20T02:23:38.594 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03'}} 2026-02-20T02:23:38.594 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03'} 2026-02-20T02:23:38.594 INFO:teuthology.task.install:Using flavor: default 2026-02-20T02:23:38.603 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T02:23:38.603 INFO:teuthology.task.install:extra packages: [] 2026-02-20T02:23:38.603 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', 'tag': None, 'wait_for_package': False} 2026-02-20T02:23:38.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:23:38.607 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', 'tag': None, 'wait_for_package': False} 2026-02-20T02:23:38.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:23:38.804 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/ 2026-02-20T02:23:38.804 INFO:teuthology.task.install.rpm:Package version is 19.2.3-700.gf4ef35d9 2026-02-20T02:23:38.815 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/ 2026-02-20T02:23:38.816 INFO:teuthology.task.install.rpm:Package version is 19.2.3-700.gf4ef35d9 2026-02-20T02:23:38.962 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T02:23:38.962 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:23:38.962 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T02:23:38.982 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T02:23:38.982 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:23:38.982 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T02:23:38.988 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T02:23:38.988 DEBUG:teuthology.orchestra.run.trial098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T02:23:39.008 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T02:23:39.008 DEBUG:teuthology.orchestra.run.trial106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T02:23:39.053 DEBUG:teuthology.orchestra.run.trial098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T02:23:39.074 DEBUG:teuthology.orchestra.run.trial106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T02:23:39.127 DEBUG:teuthology.orchestra.run.trial098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T02:23:39.148 DEBUG:teuthology.orchestra.run.trial106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T02:23:39.191 INFO:teuthology.orchestra.run.trial098.stdout:check_obsoletes = 1 2026-02-20T02:23:39.193 DEBUG:teuthology.orchestra.run.trial098:> sudo yum clean all 2026-02-20T02:23:39.212 INFO:teuthology.orchestra.run.trial106.stdout:check_obsoletes = 1 2026-02-20T02:23:39.214 DEBUG:teuthology.orchestra.run.trial106:> sudo yum clean all 2026-02-20T02:23:39.351 INFO:teuthology.orchestra.run.trial098.stdout:41 files removed 2026-02-20T02:23:39.364 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-radosgw 2026-02-20T02:23:39.373 INFO:teuthology.orchestra.run.trial106.stdout:41 files removed 2026-02-20T02:23:39.387 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-radosgw 2026-02-20T02:23:39.633 INFO:teuthology.orchestra.run.trial098.stdout:ceph packages for x86_64 675 kB/s | 86 kB 00:00 2026-02-20T02:23:39.660 INFO:teuthology.orchestra.run.trial106.stdout:ceph packages for x86_64 665 kB/s | 86 kB 00:00 2026-02-20T02:23:39.765 INFO:teuthology.orchestra.run.trial098.stdout:ceph noarch packages 112 kB/s | 12 kB 00:00 2026-02-20T02:23:39.792 INFO:teuthology.orchestra.run.trial106.stdout:ceph noarch packages 112 kB/s | 12 kB 00:00 2026-02-20T02:23:39.890 INFO:teuthology.orchestra.run.trial098.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-20T02:23:39.919 INFO:teuthology.orchestra.run.trial106.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-20T02:23:40.167 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - BaseOS 35 MB/s | 8.9 MB 00:00 2026-02-20T02:23:43.177 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-20T02:23:46.445 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 7.8 MB 00:00 2026-02-20T02:23:47.448 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 20 kB 00:00 2026-02-20T02:23:48.011 INFO:teuthology.orchestra.run.trial098.stdout:Extra Packages for Enterprise Linux 41 MB/s | 20 MB 00:00 2026-02-20T02:23:48.292 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-20T02:23:51.162 INFO:teuthology.orchestra.run.trial098.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-20T02:23:51.862 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 27 MB 00:03 2026-02-20T02:23:52.362 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:23:52.363 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:23:52.363 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repository Size 2026-02-20T02:23:52.363 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:23:52.363 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout: ceph-radosgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 11 M 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout:Upgrading: 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout: librados2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.4 M 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout: librbd1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.2 M 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout:Installing dependencies: 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout: ceph-base x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.5 M 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout: ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 22 M 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout: ceph-selinux x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 25 k 2026-02-20T02:23:52.364 INFO:teuthology.orchestra.run.trial098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 999 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: libradosstriper1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 504 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: librgw2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.4 M 2026-02-20T02:23:52.365 INFO:teuthology.orchestra.run.trial098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: python3-ceph-argparse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 45 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: python3-ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 142 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: python3-cephfs x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 165 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: python3-rados x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 322 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: python3-rbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 303 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: python3-rgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 100 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T02:23:52.366 INFO:teuthology.orchestra.run.trial098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout:Installing weak dependencies: 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout:Install 33 Packages 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout:Upgrade 2 Packages 2026-02-20T02:23:52.367 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:23:52.368 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 63 M 2026-02-20T02:23:52.368 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:23:53.786 INFO:teuthology.orchestra.run.trial098.stdout:(1/35): ceph-base-19.2.3-700.gf4ef35d9.el9.x86_ 6.0 MB/s | 5.5 MB 00:00 2026-02-20T02:23:53.836 INFO:teuthology.orchestra.run.trial098.stdout:(2/35): ceph-selinux-19.2.3-700.gf4ef35d9.el9.x 500 kB/s | 25 kB 00:00 2026-02-20T02:23:53.941 INFO:teuthology.orchestra.run.trial098.stdout:(3/35): libcephfs2-19.2.3-700.gf4ef35d9.el9.x86 9.3 MB/s | 999 kB 00:00 2026-02-20T02:23:53.999 INFO:teuthology.orchestra.run.trial098.stdout:(4/35): libradosstriper1-19.2.3-700.gf4ef35d9.e 8.6 MB/s | 504 kB 00:00 2026-02-20T02:23:54.415 INFO:teuthology.orchestra.run.trial098.stdout:(5/35): librgw2-19.2.3-700.gf4ef35d9.el9.x86_64 13 MB/s | 5.4 MB 00:00 2026-02-20T02:23:54.457 INFO:teuthology.orchestra.run.trial098.stdout:(6/35): python3-ceph-argparse-19.2.3-700.gf4ef3 1.1 MB/s | 45 kB 00:00 2026-02-20T02:23:54.499 INFO:teuthology.orchestra.run.trial098.stdout:(7/35): python3-ceph-common-19.2.3-700.gf4ef35d 3.3 MB/s | 142 kB 00:00 2026-02-20T02:23:54.539 INFO:teuthology.orchestra.run.trial098.stdout:(8/35): python3-cephfs-19.2.3-700.gf4ef35d9.el9 4.0 MB/s | 165 kB 00:00 2026-02-20T02:23:54.582 INFO:teuthology.orchestra.run.trial098.stdout:(9/35): python3-rados-19.2.3-700.gf4ef35d9.el9. 7.3 MB/s | 322 kB 00:00 2026-02-20T02:23:54.623 INFO:teuthology.orchestra.run.trial098.stdout:(10/35): python3-rbd-19.2.3-700.gf4ef35d9.el9.x 7.2 MB/s | 303 kB 00:00 2026-02-20T02:23:54.663 INFO:teuthology.orchestra.run.trial098.stdout:(11/35): python3-rgw-19.2.3-700.gf4ef35d9.el9.x 2.4 MB/s | 100 kB 00:00 2026-02-20T02:23:54.770 INFO:teuthology.orchestra.run.trial098.stdout:(12/35): mailcap-2.1.49-5.el9.noarch.rpm 311 kB/s | 33 kB 00:00 2026-02-20T02:23:54.824 INFO:teuthology.orchestra.run.trial098.stdout:(13/35): nvme-cli-2.16-1.el9.x86_64.rpm 21 MB/s | 1.2 MB 00:00 2026-02-20T02:23:54.879 INFO:teuthology.orchestra.run.trial098.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.7 MB/s | 93 kB 00:00 2026-02-20T02:23:55.276 INFO:teuthology.orchestra.run.trial098.stdout:(15/35): ceph-radosgw-19.2.3-700.gf4ef35d9.el9. 4.5 MB/s | 11 MB 00:02 2026-02-20T02:23:55.312 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 7.8 MB 00:01 2026-02-20T02:23:55.582 INFO:teuthology.orchestra.run.trial098.stdout:(16/35): ceph-common-19.2.3-700.gf4ef35d9.el9.x 8.0 MB/s | 22 MB 00:02 2026-02-20T02:23:55.583 INFO:teuthology.orchestra.run.trial098.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 148 kB/s | 104 kB 00:00 2026-02-20T02:23:55.996 INFO:teuthology.orchestra.run.trial098.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 228 kB/s | 164 kB 00:00 2026-02-20T02:23:56.163 INFO:teuthology.orchestra.run.trial098.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2026-02-20T02:23:56.220 INFO:teuthology.orchestra.run.trial106.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 20 kB 00:00 2026-02-20T02:23:56.305 INFO:teuthology.orchestra.run.trial098.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 222 kB/s | 160 kB 00:00 2026-02-20T02:23:56.875 INFO:teuthology.orchestra.run.trial098.stdout:(21/35): librdkafka-1.6.1-102.el9.x86_64.rpm 753 kB/s | 662 kB 00:00 2026-02-20T02:23:56.944 INFO:teuthology.orchestra.run.trial098.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 375 kB/s | 292 kB 00:00 2026-02-20T02:23:57.066 INFO:teuthology.orchestra.run.trial106.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-20T02:23:57.067 INFO:teuthology.orchestra.run.trial098.stdout:(23/35): qatlib-25.08.0-2.el9.x86_64.rpm 314 kB/s | 240 kB 00:00 2026-02-20T02:23:57.225 INFO:teuthology.orchestra.run.trial098.stdout:(24/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2026-02-20T02:23:57.354 INFO:teuthology.orchestra.run.trial098.stdout:(25/35): libarrow-9.0.0-15.el9.x86_64.rpm 34 MB/s | 4.4 MB 00:00 2026-02-20T02:23:57.403 INFO:teuthology.orchestra.run.trial098.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 513 kB/s | 25 kB 00:00 2026-02-20T02:23:57.436 INFO:teuthology.orchestra.run.trial098.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2026-02-20T02:23:57.451 INFO:teuthology.orchestra.run.trial098.stdout:(28/35): qatlib-service-25.08.0-2.el9.x86_64.rp 64 kB/s | 37 kB 00:00 2026-02-20T02:23:57.464 INFO:teuthology.orchestra.run.trial098.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.3 MB/s | 67 kB 00:00 2026-02-20T02:23:57.565 INFO:teuthology.orchestra.run.trial098.stdout:(30/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 107 kB/s | 66 kB 00:00 2026-02-20T02:23:57.721 INFO:teuthology.orchestra.run.trial098.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2026-02-20T02:23:57.789 INFO:teuthology.orchestra.run.trial098.stdout:(32/35): re2-20211101-20.el9.x86_64.rpm 589 kB/s | 191 kB 00:00 2026-02-20T02:23:57.840 INFO:teuthology.orchestra.run.trial098.stdout:(33/35): librados2-19.2.3-700.gf4ef35d9.el9.x86 29 MB/s | 3.4 MB 00:00 2026-02-20T02:23:57.933 INFO:teuthology.orchestra.run.trial098.stdout:(34/35): librbd1-19.2.3-700.gf4ef35d9.el9.x86_6 22 MB/s | 3.2 MB 00:00 2026-02-20T02:23:57.953 INFO:teuthology.orchestra.run.trial098.stdout:(35/35): thrift-0.15.0-4.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2026-02-20T02:23:57.956 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:23:57.956 INFO:teuthology.orchestra.run.trial098.stdout:Total 11 MB/s | 63 MB 00:05 2026-02-20T02:23:58.052 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:23:58.071 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:23:58.071 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:23:58.328 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:23:58.329 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:23:58.619 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:23:58.628 INFO:teuthology.orchestra.run.trial098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-20T02:23:58.631 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-20T02:23:58.642 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-20T02:23:58.805 INFO:teuthology.orchestra.run.trial098.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-20T02:23:58.810 INFO:teuthology.orchestra.run.trial098.stdout: Upgrading : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/37 2026-02-20T02:23:58.840 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/37 2026-02-20T02:23:58.886 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/37 2026-02-20T02:23:58.887 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/37 2026-02-20T02:23:58.900 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/37 2026-02-20T02:23:58.904 INFO:teuthology.orchestra.run.trial098.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-20T02:23:58.913 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x 9/37 2026-02-20T02:23:58.937 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 10/37 2026-02-20T02:23:58.938 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/37 2026-02-20T02:23:58.952 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/37 2026-02-20T02:23:58.984 INFO:teuthology.orchestra.run.trial098.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-20T02:23:58.988 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-20T02:23:58.994 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-20T02:23:58.997 INFO:teuthology.orchestra.run.trial098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-20T02:23:59.000 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-20T02:23:59.005 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-20T02:23:59.153 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-20T02:23:59.154 INFO:teuthology.orchestra.run.trial098.stdout: Upgrading : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 19/37 2026-02-20T02:23:59.182 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 19/37 2026-02-20T02:23:59.186 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 20/37 2026-02-20T02:23:59.192 INFO:teuthology.orchestra.run.trial098.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-20T02:23:59.430 INFO:teuthology.orchestra.run.trial098.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-20T02:23:59.432 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 23/37 2026-02-20T02:23:59.448 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 23/37 2026-02-20T02:23:59.452 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 24/37 2026-02-20T02:23:59.457 INFO:teuthology.orchestra.run.trial098.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-20T02:23:59.460 INFO:teuthology.orchestra.run.trial098.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-20T02:23:59.461 INFO:teuthology.orchestra.run.trial098.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-20T02:23:59.479 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-20T02:23:59.596 INFO:teuthology.orchestra.run.trial098.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-20T02:23:59.598 INFO:teuthology.orchestra.run.trial098.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-20T02:23:59.875 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-20T02:23:59.875 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T02:23:59.875 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:23:59.910 INFO:teuthology.orchestra.run.trial098.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-20T02:23:59.912 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86 31/37 2026-02-20T02:24:00.245 INFO:teuthology.orchestra.run.trial106.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-20T02:24:00.930 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 32/37 2026-02-20T02:24:00.932 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 32/37 2026-02-20T02:24:01.222 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 32/37 2026-02-20T02:24:01.226 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 33/37 2026-02-20T02:24:01.267 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 33/37 2026-02-20T02:24:01.267 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T02:24:01.267 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T02:24:01.267 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:01.271 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 34/37 2026-02-20T02:24:01.429 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:01.430 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:01.430 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: ceph-radosgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 11 M 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout:Upgrading: 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: librados2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.4 M 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: librbd1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.2 M 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: ceph-base x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.5 M 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 22 M 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: ceph-selinux x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 25 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 999 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: libradosstriper1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 504 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: librgw2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.4 M 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T02:24:01.431 INFO:teuthology.orchestra.run.trial106.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-argparse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 45 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 142 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: python3-cephfs x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 165 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: python3-rados x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 322 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: python3-rbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 303 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: python3-rgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 100 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout:Installing weak dependencies: 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout:Install 33 Packages 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout:Upgrade 2 Packages 2026-02-20T02:24:01.432 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:01.433 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 63 M 2026-02-20T02:24:01.433 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:02.050 INFO:teuthology.orchestra.run.trial106.stdout:(1/35): ceph-base-19.2.3-700.gf4ef35d9.el9.x86_ 14 MB/s | 5.5 MB 00:00 2026-02-20T02:24:02.096 INFO:teuthology.orchestra.run.trial106.stdout:(2/35): ceph-selinux-19.2.3-700.gf4ef35d9.el9.x 548 kB/s | 25 kB 00:00 2026-02-20T02:24:02.161 INFO:teuthology.orchestra.run.trial106.stdout:(3/35): libcephfs2-19.2.3-700.gf4ef35d9.el9.x86 15 MB/s | 999 kB 00:00 2026-02-20T02:24:02.218 INFO:teuthology.orchestra.run.trial106.stdout:(4/35): libradosstriper1-19.2.3-700.gf4ef35d9.e 8.5 MB/s | 504 kB 00:00 2026-02-20T02:24:02.325 INFO:teuthology.orchestra.run.trial106.stdout:(5/35): ceph-radosgw-19.2.3-700.gf4ef35d9.el9.x 16 MB/s | 11 MB 00:00 2026-02-20T02:24:02.372 INFO:teuthology.orchestra.run.trial106.stdout:(6/35): python3-ceph-argparse-19.2.3-700.gf4ef3 960 kB/s | 45 kB 00:00 2026-02-20T02:24:02.430 INFO:teuthology.orchestra.run.trial106.stdout:(7/35): python3-ceph-common-19.2.3-700.gf4ef35d 2.4 MB/s | 142 kB 00:00 2026-02-20T02:24:02.490 INFO:teuthology.orchestra.run.trial106.stdout:(8/35): python3-cephfs-19.2.3-700.gf4ef35d9.el9 2.7 MB/s | 165 kB 00:00 2026-02-20T02:24:02.515 INFO:teuthology.orchestra.run.trial106.stdout:(9/35): librgw2-19.2.3-700.gf4ef35d9.el9.x86_64 18 MB/s | 5.4 MB 00:00 2026-02-20T02:24:02.550 INFO:teuthology.orchestra.run.trial106.stdout:(10/35): ceph-common-19.2.3-700.gf4ef35d9.el9.x 25 MB/s | 22 MB 00:00 2026-02-20T02:24:02.551 INFO:teuthology.orchestra.run.trial106.stdout:(11/35): python3-rbd-19.2.3-700.gf4ef35d9.el9.x 7.9 MB/s | 303 kB 00:00 2026-02-20T02:24:02.552 INFO:teuthology.orchestra.run.trial106.stdout:(12/35): python3-rados-19.2.3-700.gf4ef35d9.el9 5.1 MB/s | 322 kB 00:00 2026-02-20T02:24:02.562 INFO:teuthology.orchestra.run.trial106.stdout:(13/35): python3-rgw-19.2.3-700.gf4ef35d9.el9.x 8.4 MB/s | 100 kB 00:00 2026-02-20T02:24:03.110 INFO:teuthology.orchestra.run.trial106.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 59 kB/s | 33 kB 00:00 2026-02-20T02:24:03.161 INFO:teuthology.orchestra.run.trial106.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 2.0 MB/s | 104 kB 00:00 2026-02-20T02:24:03.177 INFO:teuthology.orchestra.run.trial106.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 9.6 MB/s | 164 kB 00:00 2026-02-20T02:24:03.188 INFO:teuthology.orchestra.run.trial106.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 15 MB/s | 160 kB 00:00 2026-02-20T02:24:03.197 INFO:teuthology.orchestra.run.trial106.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 5.3 MB/s | 45 kB 00:00 2026-02-20T02:24:03.215 INFO:teuthology.orchestra.run.trial106.stdout:(19/35): pciutils-3.7.0-7.el9.x86_64.rpm 142 kB/s | 93 kB 00:00 2026-02-20T02:24:03.217 INFO:teuthology.orchestra.run.trial106.stdout:(20/35): librdkafka-1.6.1-102.el9.x86_64.rpm 31 MB/s | 662 kB 00:00 2026-02-20T02:24:03.228 INFO:teuthology.orchestra.run.trial106.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 23 MB/s | 240 kB 00:00 2026-02-20T02:24:03.236 INFO:teuthology.orchestra.run.trial106.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 4.3 MB/s | 37 kB 00:00 2026-02-20T02:24:03.245 INFO:teuthology.orchestra.run.trial106.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.6 MB/s | 66 kB 00:00 2026-02-20T02:24:03.263 INFO:teuthology.orchestra.run.trial106.stdout:(24/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.0 MB/s | 292 kB 00:00 2026-02-20T02:24:03.498 INFO:teuthology.orchestra.run.trial106.stdout:(25/35): nvme-cli-2.16-1.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:00 2026-02-20T02:24:03.706 INFO:teuthology.orchestra.run.trial106.stdout:(26/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 667 kB/s | 308 kB 00:00 2026-02-20T02:24:03.716 INFO:teuthology.orchestra.run.trial106.stdout:(27/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 114 kB/s | 25 kB 00:00 2026-02-20T02:24:03.779 INFO:teuthology.orchestra.run.trial106.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 667 kB/s | 49 kB 00:00 2026-02-20T02:24:03.894 INFO:teuthology.orchestra.run.trial106.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 380 kB/s | 67 kB 00:00 2026-02-20T02:24:03.975 INFO:teuthology.orchestra.run.trial106.stdout:(30/35): libarrow-9.0.0-15.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2026-02-20T02:24:03.978 INFO:teuthology.orchestra.run.trial106.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2026-02-20T02:24:04.059 INFO:teuthology.orchestra.run.trial106.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2026-02-20T02:24:04.075 INFO:teuthology.orchestra.run.trial106.stdout:(33/35): librados2-19.2.3-700.gf4ef35d9.el9.x86 35 MB/s | 3.4 MB 00:00 2026-02-20T02:24:04.083 INFO:teuthology.orchestra.run.trial106.stdout:(34/35): re2-20211101-20.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2026-02-20T02:24:04.161 INFO:teuthology.orchestra.run.trial106.stdout:(35/35): librbd1-19.2.3-700.gf4ef35d9.el9.x86_6 31 MB/s | 3.2 MB 00:00 2026-02-20T02:24:04.162 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:04.162 INFO:teuthology.orchestra.run.trial106.stdout:Total 23 MB/s | 63 MB 00:02 2026-02-20T02:24:04.261 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:04.279 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:04.280 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:04.536 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:04.536 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:04.827 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:04.836 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-20T02:24:04.839 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-20T02:24:04.851 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-20T02:24:05.008 INFO:teuthology.orchestra.run.trial106.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-20T02:24:05.012 INFO:teuthology.orchestra.run.trial106.stdout: Upgrading : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/37 2026-02-20T02:24:05.041 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/37 2026-02-20T02:24:05.084 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/37 2026-02-20T02:24:05.085 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/37 2026-02-20T02:24:05.095 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/37 2026-02-20T02:24:05.099 INFO:teuthology.orchestra.run.trial106.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-20T02:24:05.111 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x 9/37 2026-02-20T02:24:05.134 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 10/37 2026-02-20T02:24:05.135 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/37 2026-02-20T02:24:05.147 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/37 2026-02-20T02:24:05.179 INFO:teuthology.orchestra.run.trial106.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-20T02:24:05.182 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-20T02:24:05.188 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-20T02:24:05.191 INFO:teuthology.orchestra.run.trial106.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-20T02:24:05.194 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-20T02:24:05.199 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-20T02:24:05.341 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-20T02:24:05.342 INFO:teuthology.orchestra.run.trial106.stdout: Upgrading : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 19/37 2026-02-20T02:24:05.368 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 19/37 2026-02-20T02:24:05.370 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 20/37 2026-02-20T02:24:05.378 INFO:teuthology.orchestra.run.trial106.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-20T02:24:05.606 INFO:teuthology.orchestra.run.trial106.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-20T02:24:05.607 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 23/37 2026-02-20T02:24:05.624 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 23/37 2026-02-20T02:24:05.628 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 24/37 2026-02-20T02:24:05.634 INFO:teuthology.orchestra.run.trial106.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-20T02:24:05.637 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-20T02:24:05.637 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-20T02:24:05.655 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-20T02:24:05.771 INFO:teuthology.orchestra.run.trial106.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-20T02:24:05.774 INFO:teuthology.orchestra.run.trial106.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-20T02:24:05.797 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 34/37 2026-02-20T02:24:05.797 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /sys 2026-02-20T02:24:05.797 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /proc 2026-02-20T02:24:05.797 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /mnt 2026-02-20T02:24:05.797 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /var/tmp 2026-02-20T02:24:05.798 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /home 2026-02-20T02:24:05.798 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /root 2026-02-20T02:24:05.798 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /tmp 2026-02-20T02:24:05.798 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:06.064 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-20T02:24:06.064 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T02:24:06.064 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:06.101 INFO:teuthology.orchestra.run.trial106.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-20T02:24:06.103 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86 31/37 2026-02-20T02:24:06.276 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 35/37 2026-02-20T02:24:06.299 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 35/37 2026-02-20T02:24:06.299 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:06.299 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T02:24:06.299 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T02:24:06.299 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T02:24:06.299 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:06.301 INFO:teuthology.orchestra.run.trial098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-20T02:24:06.314 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-20T02:24:06.314 INFO:teuthology.orchestra.run.trial098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-20T02:24:06.367 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-20T02:24:06.367 INFO:teuthology.orchestra.run.trial098.stdout:Creating group 'qat' with GID 992. 2026-02-20T02:24:06.367 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:06.657 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/37 2026-02-20T02:24:06.657 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/37 2026-02-20T02:24:06.657 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 3/37 2026-02-20T02:24:06.657 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/37 2026-02-20T02:24:06.657 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/37 2026-02-20T02:24:06.657 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/37 2026-02-20T02:24:06.657 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/37 2026-02-20T02:24:06.657 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x 8/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86 9/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 10/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 12/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 13/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-20T02:24:06.658 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-20T02:24:06.659 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-20T02:24:06.660 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 34/37 2026-02-20T02:24:06.660 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-20T02:24:06.660 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 36/37 2026-02-20T02:24:06.717 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-20T02:24:06.718 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:06.718 INFO:teuthology.orchestra.run.trial098.stdout:Upgraded: 2026-02-20T02:24:06.718 INFO:teuthology.orchestra.run.trial098.stdout: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.718 INFO:teuthology.orchestra.run.trial098.stdout: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.718 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:06.718 INFO:teuthology.orchestra.run.trial098.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T02:24:06.718 INFO:teuthology.orchestra.run.trial098.stdout: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.718 INFO:teuthology.orchestra.run.trial098.stdout: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T02:24:06.719 INFO:teuthology.orchestra.run.trial098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.720 INFO:teuthology.orchestra.run.trial098.stdout: python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:06.721 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:06.759 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-test 2026-02-20T02:24:07.069 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:16 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:07.095 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 32/37 2026-02-20T02:24:07.097 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 32/37 2026-02-20T02:24:07.153 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repository Size 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout: ceph-test x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 50 M 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout:Installing dependencies: 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout: libcephsqlite x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 163 k 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout:Install 5 Packages 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:07.154 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 50 M 2026-02-20T02:24:07.155 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 212 M 2026-02-20T02:24:07.155 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:07.384 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 32/37 2026-02-20T02:24:07.388 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 33/37 2026-02-20T02:24:07.428 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 33/37 2026-02-20T02:24:07.428 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T02:24:07.429 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T02:24:07.429 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:07.432 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 34/37 2026-02-20T02:24:07.484 INFO:teuthology.orchestra.run.trial098.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 9.3 MB/s | 233 kB 00:00 2026-02-20T02:24:07.501 INFO:teuthology.orchestra.run.trial098.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 17 MB/s | 303 kB 00:00 2026-02-20T02:24:07.506 INFO:teuthology.orchestra.run.trial098.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-20T02:24:07.569 INFO:teuthology.orchestra.run.trial098.stdout:(4/5): libcephsqlite-19.2.3-700.gf4ef35d9.el9.x 1.5 MB/s | 163 kB 00:00 2026-02-20T02:24:08.494 INFO:teuthology.orchestra.run.trial098.stdout:(5/5): ceph-test-19.2.3-700.gf4ef35d9.el9.x86_6 48 MB/s | 50 MB 00:01 2026-02-20T02:24:08.495 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:08.496 INFO:teuthology.orchestra.run.trial098.stdout:Total 38 MB/s | 50 MB 00:01 2026-02-20T02:24:08.522 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:08.530 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:08.530 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:08.716 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:08.716 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:08.927 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:08.934 INFO:teuthology.orchestra.run.trial098.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-20T02:24:08.938 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-20T02:24:08.946 INFO:teuthology.orchestra.run.trial098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-20T02:24:08.947 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/5 2026-02-20T02:24:11.234 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/5 2026-02-20T02:24:11.252 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/5 2026-02-20T02:24:11.474 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/5 2026-02-20T02:24:11.474 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/5 2026-02-20T02:24:11.474 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/5 2026-02-20T02:24:11.474 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-20T02:24:11.474 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-20T02:24:11.527 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout: ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:11.528 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:11.562 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph 2026-02-20T02:24:11.871 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:20 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:11.957 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:11.959 INFO:teuthology.orchestra.run.trial098.stdout:====================================================================================== 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repository Size 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout:====================================================================================== 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout: ceph x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 6.5 k 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout:Installing dependencies: 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout: ceph-grafana-dashboards noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 31 k 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mds x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 2.4 M 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.1 M 2026-02-20T02:24:11.960 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-modules-core noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 253 k 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mon x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 4.7 M 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: ceph-osd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 17 M 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: ceph-prometheus-alerts noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 17 k 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 769 k 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T02:24:11.961 INFO:teuthology.orchestra.run.trial098.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T02:24:11.962 INFO:teuthology.orchestra.run.trial098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T02:24:11.963 INFO:teuthology.orchestra.run.trial098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T02:24:11.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T02:24:11.965 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T02:24:11.966 INFO:teuthology.orchestra.run.trial098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout:Installing weak dependencies: 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 150 k 2026-02-20T02:24:11.967 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-dashboard noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 3.8 M 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 7.4 M 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 22 k 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-rook noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 49 k 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout: ceph-volume noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 299 k 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout:====================================================================================== 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout:Install 99 Packages 2026-02-20T02:24:11.968 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:11.969 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 95 M 2026-02-20T02:24:11.969 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 520 M 2026-02-20T02:24:11.969 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:12.000 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 34/37 2026-02-20T02:24:12.001 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /sys 2026-02-20T02:24:12.001 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /proc 2026-02-20T02:24:12.001 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /mnt 2026-02-20T02:24:12.001 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /var/tmp 2026-02-20T02:24:12.001 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /home 2026-02-20T02:24:12.001 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /root 2026-02-20T02:24:12.001 INFO:teuthology.orchestra.run.trial106.stdout:skipping the directory /tmp 2026-02-20T02:24:12.001 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:12.460 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 35/37 2026-02-20T02:24:12.484 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 35/37 2026-02-20T02:24:12.484 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:12.484 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T02:24:12.484 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T02:24:12.484 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T02:24:12.484 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:12.486 INFO:teuthology.orchestra.run.trial106.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-20T02:24:12.498 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-20T02:24:12.499 INFO:teuthology.orchestra.run.trial106.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-20T02:24:12.540 INFO:teuthology.orchestra.run.trial098.stdout:(1/99): ceph-19.2.3-700.gf4ef35d9.el9.x86_64.rp 127 kB/s | 6.5 kB 00:00 2026-02-20T02:24:12.555 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-20T02:24:12.556 INFO:teuthology.orchestra.run.trial106.stdout:Creating group 'qat' with GID 992. 2026-02-20T02:24:12.556 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:12.626 INFO:teuthology.orchestra.run.trial098.stdout:(2/99): ceph-mgr-19.2.3-700.gf4ef35d9.el9.x86_6 7.9 MB/s | 1.1 MB 00:00 2026-02-20T02:24:12.650 INFO:teuthology.orchestra.run.trial098.stdout:(3/99): ceph-mds-19.2.3-700.gf4ef35d9.el9.x86_6 15 MB/s | 2.4 MB 00:00 2026-02-20T02:24:12.679 INFO:teuthology.orchestra.run.trial098.stdout:(4/99): ceph-grafana-dashboards-19.2.3-700.gf4e 1.0 MB/s | 31 kB 00:00 2026-02-20T02:24:12.713 INFO:teuthology.orchestra.run.trial098.stdout:(5/99): ceph-mgr-cephadm-19.2.3-700.gf4ef35d9.e 4.4 MB/s | 150 kB 00:00 2026-02-20T02:24:12.833 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/37 2026-02-20T02:24:12.833 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/37 2026-02-20T02:24:12.833 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 3/37 2026-02-20T02:24:12.833 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/37 2026-02-20T02:24:12.833 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/37 2026-02-20T02:24:12.833 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/37 2026-02-20T02:24:12.833 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x 8/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86 9/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 10/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 12/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 13/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-20T02:24:12.834 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-20T02:24:12.835 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-20T02:24:12.836 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-20T02:24:12.836 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-20T02:24:12.836 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 34/37 2026-02-20T02:24:12.836 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-20T02:24:12.836 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 36/37 2026-02-20T02:24:12.856 INFO:teuthology.orchestra.run.trial098.stdout:(6/99): ceph-mon-19.2.3-700.gf4ef35d9.el9.x86_6 15 MB/s | 4.7 MB 00:00 2026-02-20T02:24:12.876 INFO:teuthology.orchestra.run.trial098.stdout:(7/99): ceph-mgr-dashboard-19.2.3-700.gf4ef35d9 23 MB/s | 3.8 MB 00:00 2026-02-20T02:24:12.895 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-20T02:24:12.895 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:12.895 INFO:teuthology.orchestra.run.trial106.stdout:Upgraded: 2026-02-20T02:24:12.895 INFO:teuthology.orchestra.run.trial106.stdout: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.895 INFO:teuthology.orchestra.run.trial106.stdout: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T02:24:12.896 INFO:teuthology.orchestra.run.trial106.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T02:24:12.897 INFO:teuthology.orchestra.run.trial106.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T02:24:12.898 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:12.899 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:12.912 INFO:teuthology.orchestra.run.trial098.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-700.gf4ef35d9 606 kB/s | 22 kB 00:00 2026-02-20T02:24:12.940 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-test 2026-02-20T02:24:12.956 INFO:teuthology.orchestra.run.trial098.stdout:(9/99): ceph-mgr-modules-core-19.2.3-700.gf4ef3 5.6 MB/s | 253 kB 00:00 2026-02-20T02:24:12.999 INFO:teuthology.orchestra.run.trial098.stdout:(10/99): ceph-mgr-rook-19.2.3-700.gf4ef35d9.el9 1.1 MB/s | 49 kB 00:00 2026-02-20T02:24:13.043 INFO:teuthology.orchestra.run.trial098.stdout:(11/99): ceph-prometheus-alerts-19.2.3-700.gf4e 379 kB/s | 17 kB 00:00 2026-02-20T02:24:13.095 INFO:teuthology.orchestra.run.trial098.stdout:(12/99): ceph-volume-19.2.3-700.gf4ef35d9.el9.n 5.7 MB/s | 299 kB 00:00 2026-02-20T02:24:13.157 INFO:teuthology.orchestra.run.trial098.stdout:(13/99): cephadm-19.2.3-700.gf4ef35d9.el9.noarc 12 MB/s | 769 kB 00:00 2026-02-20T02:24:13.199 INFO:teuthology.orchestra.run.trial098.stdout:(14/99): ceph-mgr-diskprediction-local-19.2.3-7 22 MB/s | 7.4 MB 00:00 2026-02-20T02:24:13.245 INFO:teuthology.orchestra.run.trial098.stdout:(15/99): ceph-osd-19.2.3-700.gf4ef35d9.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-20T02:24:13.259 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:13 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:13.341 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:13.342 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout: ceph-test x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 50 M 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout: libcephsqlite x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 163 k 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T02:24:13.343 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:13.344 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:13.344 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:13.344 INFO:teuthology.orchestra.run.trial106.stdout:Install 5 Packages 2026-02-20T02:24:13.344 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:13.344 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 50 M 2026-02-20T02:24:13.344 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 212 M 2026-02-20T02:24:13.344 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:13.475 INFO:teuthology.orchestra.run.trial106.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 8.8 MB/s | 233 kB 00:00 2026-02-20T02:24:13.487 INFO:teuthology.orchestra.run.trial106.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 25 MB/s | 303 kB 00:00 2026-02-20T02:24:13.492 INFO:teuthology.orchestra.run.trial106.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 14 MB/s | 64 kB 00:00 2026-02-20T02:24:13.537 INFO:teuthology.orchestra.run.trial106.stdout:(4/5): libcephsqlite-19.2.3-700.gf4ef35d9.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-20T02:24:13.598 INFO:teuthology.orchestra.run.trial098.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 101 kB/s | 40 kB 00:00 2026-02-20T02:24:13.724 INFO:teuthology.orchestra.run.trial098.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 150 kB/s | 72 kB 00:00 2026-02-20T02:24:13.956 INFO:teuthology.orchestra.run.trial098.stdout:(18/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 439 kB/s | 351 kB 00:00 2026-02-20T02:24:13.962 INFO:teuthology.orchestra.run.trial098.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 777 kB/s | 184 kB 00:00 2026-02-20T02:24:14.274 INFO:teuthology.orchestra.run.trial098.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 797 kB/s | 253 kB 00:00 2026-02-20T02:24:14.435 INFO:teuthology.orchestra.run.trial098.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 661 kB/s | 106 kB 00:00 2026-02-20T02:24:14.577 INFO:teuthology.orchestra.run.trial098.stdout:(22/99): libgfortran-11.5.0-14.el9.x86_64.rpm 812 kB/s | 794 kB 00:00 2026-02-20T02:24:14.597 INFO:teuthology.orchestra.run.trial098.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 838 kB/s | 135 kB 00:00 2026-02-20T02:24:14.628 INFO:teuthology.orchestra.run.trial106.stdout:(5/5): ceph-test-19.2.3-700.gf4ef35d9.el9.x86_6 42 MB/s | 50 MB 00:01 2026-02-20T02:24:14.629 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:14.629 INFO:teuthology.orchestra.run.trial106.stdout:Total 39 MB/s | 50 MB 00:01 2026-02-20T02:24:14.657 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:14.667 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:14.667 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:14.758 INFO:teuthology.orchestra.run.trial098.stdout:(24/99): python3-requests-2.25.1-10.el9.noarch. 786 kB/s | 126 kB 00:00 2026-02-20T02:24:14.815 INFO:teuthology.orchestra.run.trial098.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 632 kB/s | 150 kB 00:00 2026-02-20T02:24:14.854 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:14.854 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:15.053 INFO:teuthology.orchestra.run.trial098.stdout:(26/99): unzip-6.0-59.el9.x86_64.rpm 763 kB/s | 182 kB 00:00 2026-02-20T02:24:15.066 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:15.072 INFO:teuthology.orchestra.run.trial106.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-20T02:24:15.075 INFO:teuthology.orchestra.run.trial098.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 687 kB/s | 218 kB 00:00 2026-02-20T02:24:15.076 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-20T02:24:15.084 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-20T02:24:15.085 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/5 2026-02-20T02:24:15.369 INFO:teuthology.orchestra.run.trial098.stdout:(28/99): zip-3.0-35.el9.x86_64.rpm 841 kB/s | 266 kB 00:00 2026-02-20T02:24:15.445 INFO:teuthology.orchestra.run.trial098.stdout:(29/99): python3-cryptography-36.0.1-5.el9.x86_ 860 kB/s | 1.2 MB 00:01 2026-02-20T02:24:15.636 INFO:teuthology.orchestra.run.trial098.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 53 kB/s | 30 kB 00:00 2026-02-20T02:24:15.928 INFO:teuthology.orchestra.run.trial098.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 31 kB/s | 15 kB 00:00 2026-02-20T02:24:16.405 INFO:teuthology.orchestra.run.trial098.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 320 kB/s | 246 kB 00:00 2026-02-20T02:24:16.415 INFO:teuthology.orchestra.run.trial098.stdout:(33/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.9 MB/s | 3.0 MB 00:01 2026-02-20T02:24:16.665 INFO:teuthology.orchestra.run.trial098.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 256 kB/s | 188 kB 00:00 2026-02-20T02:24:16.984 INFO:teuthology.orchestra.run.trial098.stdout:(35/99): openblas-0.3.29-1.el9.x86_64.rpm 73 kB/s | 42 kB 00:00 2026-02-20T02:24:17.380 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/5 2026-02-20T02:24:17.397 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/5 2026-02-20T02:24:17.527 INFO:teuthology.orchestra.run.trial098.stdout:(36/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.8 MB/s | 5.3 MB 00:01 2026-02-20T02:24:17.588 INFO:teuthology.orchestra.run.trial098.stdout:(37/99): protobuf-3.14.0-17.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-20T02:24:17.631 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/5 2026-02-20T02:24:17.631 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/5 2026-02-20T02:24:17.631 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/5 2026-02-20T02:24:17.631 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-20T02:24:17.631 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-20T02:24:17.685 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-20T02:24:17.686 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:17.686 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:17.686 INFO:teuthology.orchestra.run.trial106.stdout: ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:17.686 INFO:teuthology.orchestra.run.trial106.stdout: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:17.686 INFO:teuthology.orchestra.run.trial106.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T02:24:17.686 INFO:teuthology.orchestra.run.trial106.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T02:24:17.687 INFO:teuthology.orchestra.run.trial106.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T02:24:17.687 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:17.687 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:17.720 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph 2026-02-20T02:24:18.027 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:18 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:18.105 INFO:teuthology.orchestra.run.trial098.stdout:(38/99): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2026-02-20T02:24:18.115 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout:====================================================================================== 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repository Size 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout:====================================================================================== 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout: ceph x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 6.5 k 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout: ceph-grafana-dashboards noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 31 k 2026-02-20T02:24:18.118 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mds x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 2.4 M 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.1 M 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-modules-core noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 253 k 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mon x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 4.7 M 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 17 M 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: ceph-prometheus-alerts noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 17 k 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 769 k 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T02:24:18.119 INFO:teuthology.orchestra.run.trial106.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T02:24:18.120 INFO:teuthology.orchestra.run.trial106.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T02:24:18.121 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-20T02:24:18.122 INFO:teuthology.orchestra.run.trial106.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T02:24:18.123 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T02:24:18.124 INFO:teuthology.orchestra.run.trial106.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout:Installing weak dependencies: 2026-02-20T02:24:18.125 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 150 k 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-dashboard noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 3.8 M 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 7.4 M 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 22 k 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-rook noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 49 k 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: ceph-volume noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 299 k 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout:====================================================================================== 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout:Install 99 Packages 2026-02-20T02:24:18.126 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:18.127 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 95 M 2026-02-20T02:24:18.127 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 520 M 2026-02-20T02:24:18.127 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:18.287 INFO:teuthology.orchestra.run.trial098.stdout:(39/99): python3-devel-3.9.25-3.el9.x86_64.rpm 322 kB/s | 244 kB 00:00 2026-02-20T02:24:18.359 INFO:teuthology.orchestra.run.trial098.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 323 kB/s | 249 kB 00:00 2026-02-20T02:24:18.833 INFO:teuthology.orchestra.run.trial098.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 243 kB/s | 177 kB 00:00 2026-02-20T02:24:18.996 INFO:teuthology.orchestra.run.trial106.stdout:(1/99): ceph-19.2.3-700.gf4ef35d9.el9.x86_64.rp 127 kB/s | 6.5 kB 00:00 2026-02-20T02:24:19.088 INFO:teuthology.orchestra.run.trial106.stdout:(2/99): ceph-mgr-19.2.3-700.gf4ef35d9.el9.x86_6 7.5 MB/s | 1.1 MB 00:00 2026-02-20T02:24:19.089 INFO:teuthology.orchestra.run.trial098.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 236 kB/s | 172 kB 00:00 2026-02-20T02:24:19.113 INFO:teuthology.orchestra.run.trial106.stdout:(3/99): ceph-mds-19.2.3-700.gf4ef35d9.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-20T02:24:19.146 INFO:teuthology.orchestra.run.trial106.stdout:(4/99): ceph-grafana-dashboards-19.2.3-700.gf4e 955 kB/s | 31 kB 00:00 2026-02-20T02:24:19.183 INFO:teuthology.orchestra.run.trial106.stdout:(5/99): ceph-mgr-cephadm-19.2.3-700.gf4ef35d9.e 4.0 MB/s | 150 kB 00:00 2026-02-20T02:24:19.221 INFO:teuthology.orchestra.run.trial106.stdout:(6/99): ceph-mon-19.2.3-700.gf4ef35d9.el9.x86_6 21 MB/s | 4.7 MB 00:00 2026-02-20T02:24:19.237 INFO:teuthology.orchestra.run.trial098.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.3 MB/s | 1.2 MB 00:00 2026-02-20T02:24:19.380 INFO:teuthology.orchestra.run.trial106.stdout:(7/99): ceph-mgr-dashboard-19.2.3-700.gf4ef35d9 19 MB/s | 3.8 MB 00:00 2026-02-20T02:24:19.398 INFO:teuthology.orchestra.run.trial098.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 61 kB/s | 35 kB 00:00 2026-02-20T02:24:19.423 INFO:teuthology.orchestra.run.trial106.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-700.gf4ef35d9 515 kB/s | 22 kB 00:00 2026-02-20T02:24:19.473 INFO:teuthology.orchestra.run.trial106.stdout:(9/99): ceph-mgr-modules-core-19.2.3-700.gf4ef3 5.0 MB/s | 253 kB 00:00 2026-02-20T02:24:19.520 INFO:teuthology.orchestra.run.trial106.stdout:(10/99): ceph-mgr-rook-19.2.3-700.gf4ef35d9.el9 1.0 MB/s | 49 kB 00:00 2026-02-20T02:24:19.539 INFO:teuthology.orchestra.run.trial106.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-7 23 MB/s | 7.4 MB 00:00 2026-02-20T02:24:19.554 INFO:teuthology.orchestra.run.trial106.stdout:(12/99): ceph-prometheus-alerts-19.2.3-700.gf4e 490 kB/s | 17 kB 00:00 2026-02-20T02:24:19.570 INFO:teuthology.orchestra.run.trial106.stdout:(13/99): ceph-volume-19.2.3-700.gf4ef35d9.el9.n 9.5 MB/s | 299 kB 00:00 2026-02-20T02:24:19.599 INFO:teuthology.orchestra.run.trial106.stdout:(14/99): cephadm-19.2.3-700.gf4ef35d9.el9.noarc 17 MB/s | 769 kB 00:00 2026-02-20T02:24:19.643 INFO:teuthology.orchestra.run.trial106.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 938 kB/s | 40 kB 00:00 2026-02-20T02:24:19.646 INFO:teuthology.orchestra.run.trial106.stdout:(16/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 4.5 MB/s | 351 kB 00:00 2026-02-20T02:24:19.670 INFO:teuthology.orchestra.run.trial106.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 2.6 MB/s | 72 kB 00:00 2026-02-20T02:24:19.699 INFO:teuthology.orchestra.run.trial106.stdout:(18/99): ceph-osd-19.2.3-700.gf4ef35d9.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-20T02:24:19.701 INFO:teuthology.orchestra.run.trial106.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 14 MB/s | 794 kB 00:00 2026-02-20T02:24:19.702 INFO:teuthology.orchestra.run.trial106.stdout:(20/99): libquadmath-11.5.0-14.el9.x86_64.rpm 5.6 MB/s | 184 kB 00:00 2026-02-20T02:24:19.727 INFO:teuthology.orchestra.run.trial106.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 4.2 MB/s | 106 kB 00:00 2026-02-20T02:24:19.729 INFO:teuthology.orchestra.run.trial106.stdout:(22/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.7 MB/s | 253 kB 00:00 2026-02-20T02:24:19.735 INFO:teuthology.orchestra.run.trial106.stdout:(23/99): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-20T02:24:19.755 INFO:teuthology.orchestra.run.trial106.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 5.6 MB/s | 150 kB 00:00 2026-02-20T02:24:19.757 INFO:teuthology.orchestra.run.trial106.stdout:(25/99): python3-pycparser-2.20-6.el9.noarch.rp 4.4 MB/s | 135 kB 00:00 2026-02-20T02:24:19.768 INFO:teuthology.orchestra.run.trial106.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 3.8 MB/s | 126 kB 00:00 2026-02-20T02:24:19.787 INFO:teuthology.orchestra.run.trial106.stdout:(27/99): unzip-6.0-59.el9.x86_64.rpm 5.8 MB/s | 182 kB 00:00 2026-02-20T02:24:19.799 INFO:teuthology.orchestra.run.trial106.stdout:(28/99): python3-urllib3-1.26.5-7.el9.noarch.rp 4.9 MB/s | 218 kB 00:00 2026-02-20T02:24:19.808 INFO:teuthology.orchestra.run.trial106.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 6.6 MB/s | 266 kB 00:00 2026-02-20T02:24:19.819 INFO:teuthology.orchestra.run.trial106.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 933 kB/s | 30 kB 00:00 2026-02-20T02:24:19.833 INFO:teuthology.orchestra.run.trial106.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 597 kB/s | 15 kB 00:00 2026-02-20T02:24:19.845 INFO:teuthology.orchestra.run.trial106.stdout:(32/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 65 MB/s | 3.0 MB 00:00 2026-02-20T02:24:19.857 INFO:teuthology.orchestra.run.trial106.stdout:(33/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 6.4 MB/s | 246 kB 00:00 2026-02-20T02:24:19.863 INFO:teuthology.orchestra.run.trial106.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 6.1 MB/s | 188 kB 00:00 2026-02-20T02:24:19.871 INFO:teuthology.orchestra.run.trial106.stdout:(35/99): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-20T02:24:19.899 INFO:teuthology.orchestra.run.trial106.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 28 MB/s | 1.0 MB 00:00 2026-02-20T02:24:19.937 INFO:teuthology.orchestra.run.trial106.stdout:(37/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 67 MB/s | 5.3 MB 00:00 2026-02-20T02:24:19.944 INFO:teuthology.orchestra.run.trial106.stdout:(38/99): python3-babel-2.9.1-2.el9.noarch.rpm 82 MB/s | 6.0 MB 00:00 2026-02-20T02:24:19.944 INFO:teuthology.orchestra.run.trial106.stdout:(39/99): python3-devel-3.9.25-3.el9.x86_64.rpm 5.3 MB/s | 244 kB 00:00 2026-02-20T02:24:19.967 INFO:teuthology.orchestra.run.trial106.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.1 MB/s | 249 kB 00:00 2026-02-20T02:24:19.974 INFO:teuthology.orchestra.run.trial106.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 5.9 MB/s | 177 kB 00:00 2026-02-20T02:24:20.003 INFO:teuthology.orchestra.run.trial106.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.2 MB/s | 35 kB 00:00 2026-02-20T02:24:20.004 INFO:teuthology.orchestra.run.trial106.stdout:(43/99): python3-mako-1.1.4-6.el9.noarch.rpm 4.5 MB/s | 172 kB 00:00 2026-02-20T02:24:20.012 INFO:teuthology.orchestra.run.trial106.stdout:(44/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 18 MB/s | 1.2 MB 00:00 2026-02-20T02:24:20.033 INFO:teuthology.orchestra.run.trial098.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 122 kB/s | 77 kB 00:00 2026-02-20T02:24:20.034 INFO:teuthology.orchestra.run.trial106.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-20T02:24:20.042 INFO:teuthology.orchestra.run.trial106.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 2.5 MB/s | 77 kB 00:00 2026-02-20T02:24:20.065 INFO:teuthology.orchestra.run.trial098.stdout:(46/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 534 kB/s | 442 kB 00:00 2026-02-20T02:24:20.068 INFO:teuthology.orchestra.run.trial106.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 7.9 MB/s | 267 kB 00:00 2026-02-20T02:24:20.077 INFO:teuthology.orchestra.run.trial106.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 4.4 MB/s | 159 kB 00:00 2026-02-20T02:24:20.093 INFO:teuthology.orchestra.run.trial106.stdout:(49/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 69 MB/s | 6.1 MB 00:00 2026-02-20T02:24:20.101 INFO:teuthology.orchestra.run.trial106.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 8.2 MB/s | 279 kB 00:00 2026-02-20T02:24:20.110 INFO:teuthology.orchestra.run.trial106.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 1.6 MB/s | 54 kB 00:00 2026-02-20T02:24:20.128 INFO:teuthology.orchestra.run.trial106.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-20T02:24:20.141 INFO:teuthology.orchestra.run.trial106.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.0 MB/s | 189 kB 00:00 2026-02-20T02:24:20.158 INFO:teuthology.orchestra.run.trial106.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 2.9 MB/s | 90 kB 00:00 2026-02-20T02:24:20.215 INFO:teuthology.orchestra.run.trial098.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.4 MB/s | 6.1 MB 00:01 2026-02-20T02:24:20.274 INFO:teuthology.orchestra.run.trial106.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 106 MB/s | 19 MB 00:00 2026-02-20T02:24:20.550 INFO:teuthology.orchestra.run.trial106.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 55 kB/s | 22 kB 00:00 2026-02-20T02:24:20.605 INFO:teuthology.orchestra.run.trial106.stdout:(57/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.6 MB/s | 551 kB 00:00 2026-02-20T02:24:20.649 INFO:teuthology.orchestra.run.trial106.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 3.3 MB/s | 151 kB 00:00 2026-02-20T02:24:20.709 INFO:teuthology.orchestra.run.trial106.stdout:(59/99): grpc-data-1.46.7-10.el9.noarch.rpm 122 kB/s | 19 kB 00:00 2026-02-20T02:24:20.713 INFO:teuthology.orchestra.run.trial106.stdout:(60/99): python3-asyncssh-2.13.2-5.el9.noarch.r 8.4 MB/s | 548 kB 00:00 2026-02-20T02:24:20.752 INFO:teuthology.orchestra.run.trial106.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 1.5 MB/s | 60 kB 00:00 2026-02-20T02:24:20.768 INFO:teuthology.orchestra.run.trial106.stdout:(62/99): python3-autocommand-2.2.2-8.el9.noarch 503 kB/s | 29 kB 00:00 2026-02-20T02:24:20.782 INFO:teuthology.orchestra.run.trial098.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 221 kB/s | 159 kB 00:00 2026-02-20T02:24:20.791 INFO:teuthology.orchestra.run.trial106.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.1 MB/s | 43 kB 00:00 2026-02-20T02:24:20.803 INFO:teuthology.orchestra.run.trial098.stdout:(49/99): python3-protobuf-3.14.0-17.el9.noarch. 347 kB/s | 267 kB 00:00 2026-02-20T02:24:20.827 INFO:teuthology.orchestra.run.trial106.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 542 kB/s | 32 kB 00:00 2026-02-20T02:24:20.829 INFO:teuthology.orchestra.run.trial106.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 373 kB/s | 14 kB 00:00 2026-02-20T02:24:20.882 INFO:teuthology.orchestra.run.trial106.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 6.7 MB/s | 358 kB 00:00 2026-02-20T02:24:20.928 INFO:teuthology.orchestra.run.trial106.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 5.3 MB/s | 254 kB 00:00 2026-02-20T02:24:20.953 INFO:teuthology.orchestra.run.trial106.stdout:(68/99): python3-cheroot-10.0.1-4.el9.noarch.rp 1.3 MB/s | 173 kB 00:00 2026-02-20T02:24:20.999 INFO:teuthology.orchestra.run.trial098.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 356 kB/s | 279 kB 00:00 2026-02-20T02:24:21.014 INFO:teuthology.orchestra.run.trial106.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.3 MB/s | 144 kB 00:00 2026-02-20T02:24:21.044 INFO:teuthology.orchestra.run.trial106.stdout:(70/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 18 MB/s | 2.0 MB 00:00 2026-02-20T02:24:21.071 INFO:teuthology.orchestra.run.trial106.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 2.4 MB/s | 139 kB 00:00 2026-02-20T02:24:21.082 INFO:teuthology.orchestra.run.trial106.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 1.4 MB/s | 56 kB 00:00 2026-02-20T02:24:21.109 INFO:teuthology.orchestra.run.trial106.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 282 kB/s | 11 kB 00:00 2026-02-20T02:24:21.120 INFO:teuthology.orchestra.run.trial106.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 468 kB/s | 18 kB 00:00 2026-02-20T02:24:21.150 INFO:teuthology.orchestra.run.trial106.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 574 kB/s | 23 kB 00:00 2026-02-20T02:24:21.158 INFO:teuthology.orchestra.run.trial106.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 519 kB/s | 20 kB 00:00 2026-02-20T02:24:21.190 INFO:teuthology.orchestra.run.trial106.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 485 kB/s | 19 kB 00:00 2026-02-20T02:24:21.196 INFO:teuthology.orchestra.run.trial106.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 698 kB/s | 26 kB 00:00 2026-02-20T02:24:21.234 INFO:teuthology.orchestra.run.trial106.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 1.2 MB/s | 46 kB 00:00 2026-02-20T02:24:21.272 INFO:teuthology.orchestra.run.trial106.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 2.0 MB/s | 79 kB 00:00 2026-02-20T02:24:21.311 INFO:teuthology.orchestra.run.trial106.stdout:(81/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2026-02-20T02:24:21.329 INFO:teuthology.orchestra.run.trial106.stdout:(82/99): python3-kubernetes-26.1.0-3.el9.noarch 7.3 MB/s | 1.0 MB 00:00 2026-02-20T02:24:21.349 INFO:teuthology.orchestra.run.trial106.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.5 MB/s | 58 kB 00:00 2026-02-20T02:24:21.373 INFO:teuthology.orchestra.run.trial106.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 6.1 MB/s | 272 kB 00:00 2026-02-20T02:24:21.386 INFO:teuthology.orchestra.run.trial098.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 89 kB/s | 54 kB 00:00 2026-02-20T02:24:21.387 INFO:teuthology.orchestra.run.trial106.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 435 kB/s | 16 kB 00:00 2026-02-20T02:24:21.412 INFO:teuthology.orchestra.run.trial106.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.2 MB/s | 90 kB 00:00 2026-02-20T02:24:21.425 INFO:teuthology.orchestra.run.trial106.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 814 kB/s | 31 kB 00:00 2026-02-20T02:24:21.454 INFO:teuthology.orchestra.run.trial106.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2026-02-20T02:24:21.463 INFO:teuthology.orchestra.run.trial106.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 1.5 MB/s | 59 kB 00:00 2026-02-20T02:24:21.494 INFO:teuthology.orchestra.run.trial106.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 3.0 MB/s | 125 kB 00:00 2026-02-20T02:24:21.501 INFO:teuthology.orchestra.run.trial106.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 944 kB/s | 36 kB 00:00 2026-02-20T02:24:21.521 INFO:teuthology.orchestra.run.trial106.stdout:(92/99): protobuf-compiler-3.14.0-17.el9.x86_64 633 kB/s | 862 kB 00:01 2026-02-20T02:24:21.534 INFO:teuthology.orchestra.run.trial106.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 2.2 MB/s | 86 kB 00:00 2026-02-20T02:24:21.541 INFO:teuthology.orchestra.run.trial106.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 5.6 MB/s | 230 kB 00:00 2026-02-20T02:24:21.576 INFO:teuthology.orchestra.run.trial098.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2026-02-20T02:24:21.579 INFO:teuthology.orchestra.run.trial106.stdout:(95/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.2 MB/s | 48 kB 00:00 2026-02-20T02:24:21.582 INFO:teuthology.orchestra.run.trial106.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 8.6 MB/s | 427 kB 00:00 2026-02-20T02:24:21.617 INFO:teuthology.orchestra.run.trial106.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 586 kB/s | 22 kB 00:00 2026-02-20T02:24:21.621 INFO:teuthology.orchestra.run.trial106.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 521 kB/s | 20 kB 00:00 2026-02-20T02:24:21.740 INFO:teuthology.orchestra.run.trial106.stdout:(99/99): python3-websocket-client-1.2.3-2.el9.n 410 kB/s | 90 kB 00:00 2026-02-20T02:24:21.744 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:21.744 INFO:teuthology.orchestra.run.trial106.stdout:Total 26 MB/s | 95 MB 00:03 2026-02-20T02:24:22.121 INFO:teuthology.orchestra.run.trial098.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 257 kB/s | 189 kB 00:00 2026-02-20T02:24:22.144 INFO:teuthology.orchestra.run.trial098.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 943 kB/s | 22 kB 00:00 2026-02-20T02:24:22.187 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:22.218 INFO:teuthology.orchestra.run.trial098.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 14 MB/s | 19 MB 00:01 2026-02-20T02:24:22.220 INFO:teuthology.orchestra.run.trial098.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 11 MB/s | 862 kB 00:00 2026-02-20T02:24:22.224 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:22.224 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:22.228 INFO:teuthology.orchestra.run.trial098.stdout:(57/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 139 kB/s | 90 kB 00:00 2026-02-20T02:24:22.296 INFO:teuthology.orchestra.run.trial098.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 257 kB/s | 19 kB 00:00 2026-02-20T02:24:22.361 INFO:teuthology.orchestra.run.trial098.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2026-02-20T02:24:22.391 INFO:teuthology.orchestra.run.trial098.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 996 kB/s | 29 kB 00:00 2026-02-20T02:24:22.421 INFO:teuthology.orchestra.run.trial098.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 2.0 MB/s | 60 kB 00:00 2026-02-20T02:24:22.424 INFO:teuthology.orchestra.run.trial098.stdout:(62/99): python3-asyncssh-2.13.2-5.el9.noarch.r 4.2 MB/s | 548 kB 00:00 2026-02-20T02:24:22.449 INFO:teuthology.orchestra.run.trial098.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 1.3 MB/s | 32 kB 00:00 2026-02-20T02:24:22.450 INFO:teuthology.orchestra.run.trial098.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.5 MB/s | 43 kB 00:00 2026-02-20T02:24:22.467 INFO:teuthology.orchestra.run.trial098.stdout:(65/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.2 MB/s | 551 kB 00:00 2026-02-20T02:24:22.485 INFO:teuthology.orchestra.run.trial098.stdout:(66/99): python3-certifi-2023.05.07-4.el9.noarc 396 kB/s | 14 kB 00:00 2026-02-20T02:24:22.503 INFO:teuthology.orchestra.run.trial098.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 3.2 MB/s | 173 kB 00:00 2026-02-20T02:24:22.513 INFO:teuthology.orchestra.run.trial098.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 7.5 MB/s | 358 kB 00:00 2026-02-20T02:24:22.515 INFO:teuthology.orchestra.run.trial098.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 8.1 MB/s | 254 kB 00:00 2026-02-20T02:24:22.543 INFO:teuthology.orchestra.run.trial098.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 4.9 MB/s | 139 kB 00:00 2026-02-20T02:24:22.552 INFO:teuthology.orchestra.run.trial098.stdout:(71/99): python3-grpcio-tools-1.46.7-10.el9.x86 3.7 MB/s | 144 kB 00:00 2026-02-20T02:24:22.568 INFO:teuthology.orchestra.run.trial098.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 2.2 MB/s | 56 kB 00:00 2026-02-20T02:24:22.584 INFO:teuthology.orchestra.run.trial098.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 331 kB/s | 11 kB 00:00 2026-02-20T02:24:22.593 INFO:teuthology.orchestra.run.trial098.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 719 kB/s | 18 kB 00:00 2026-02-20T02:24:22.616 INFO:teuthology.orchestra.run.trial098.stdout:(75/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 18 MB/s | 2.0 MB 00:00 2026-02-20T02:24:22.617 INFO:teuthology.orchestra.run.trial098.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 707 kB/s | 23 kB 00:00 2026-02-20T02:24:22.618 INFO:teuthology.orchestra.run.trial098.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 796 kB/s | 20 kB 00:00 2026-02-20T02:24:22.639 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:22.639 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:22.641 INFO:teuthology.orchestra.run.trial098.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 747 kB/s | 19 kB 00:00 2026-02-20T02:24:22.651 INFO:teuthology.orchestra.run.trial098.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 778 kB/s | 26 kB 00:00 2026-02-20T02:24:22.666 INFO:teuthology.orchestra.run.trial098.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 1.9 MB/s | 46 kB 00:00 2026-02-20T02:24:22.672 INFO:teuthology.orchestra.run.trial098.stdout:(81/99): python3-kubernetes-26.1.0-3.el9.noarch 19 MB/s | 1.0 MB 00:00 2026-02-20T02:24:22.686 INFO:teuthology.orchestra.run.trial098.stdout:(82/99): python3-more-itertools-8.12.0-2.el9.no 2.2 MB/s | 79 kB 00:00 2026-02-20T02:24:22.691 INFO:teuthology.orchestra.run.trial098.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.4 MB/s | 86 kB 00:00 2026-02-20T02:24:22.698 INFO:teuthology.orchestra.run.trial098.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2026-02-20T02:24:22.715 INFO:teuthology.orchestra.run.trial098.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 696 kB/s | 16 kB 00:00 2026-02-20T02:24:22.723 INFO:teuthology.orchestra.run.trial098.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.4 MB/s | 90 kB 00:00 2026-02-20T02:24:22.729 INFO:teuthology.orchestra.run.trial098.stdout:(87/99): python3-pecan-1.4.2-3.el9.noarch.rpm 6.2 MB/s | 272 kB 00:00 2026-02-20T02:24:22.739 INFO:teuthology.orchestra.run.trial098.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 1.3 MB/s | 31 kB 00:00 2026-02-20T02:24:22.750 INFO:teuthology.orchestra.run.trial098.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 7.0 MB/s | 188 kB 00:00 2026-02-20T02:24:22.764 INFO:teuthology.orchestra.run.trial098.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 4.8 MB/s | 125 kB 00:00 2026-02-20T02:24:22.766 INFO:teuthology.orchestra.run.trial098.stdout:(91/99): python3-rsa-4.9-2.el9.noarch.rpm 1.6 MB/s | 59 kB 00:00 2026-02-20T02:24:22.774 INFO:teuthology.orchestra.run.trial098.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2026-02-20T02:24:22.789 INFO:teuthology.orchestra.run.trial098.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 3.4 MB/s | 86 kB 00:00 2026-02-20T02:24:22.800 INFO:teuthology.orchestra.run.trial098.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 3.4 MB/s | 90 kB 00:00 2026-02-20T02:24:22.807 INFO:teuthology.orchestra.run.trial098.stdout:(95/99): python3-webob-1.8.8-2.el9.noarch.rpm 5.6 MB/s | 230 kB 00:00 2026-02-20T02:24:22.817 INFO:teuthology.orchestra.run.trial098.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 15 MB/s | 427 kB 00:00 2026-02-20T02:24:22.826 INFO:teuthology.orchestra.run.trial098.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.9 MB/s | 48 kB 00:00 2026-02-20T02:24:22.840 INFO:teuthology.orchestra.run.trial098.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 677 kB/s | 22 kB 00:00 2026-02-20T02:24:22.841 INFO:teuthology.orchestra.run.trial098.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 818 kB/s | 20 kB 00:00 2026-02-20T02:24:22.843 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:22.843 INFO:teuthology.orchestra.run.trial098.stdout:Total 8.8 MB/s | 95 MB 00:10 2026-02-20T02:24:23.101 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:23.103 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-20T02:24:23.133 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-20T02:24:23.138 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-20T02:24:23.159 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-20T02:24:23.165 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-20T02:24:23.198 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-20T02:24:23.207 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-20T02:24:23.212 INFO:teuthology.orchestra.run.trial106.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-20T02:24:23.214 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-20T02:24:23.219 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-20T02:24:23.241 INFO:teuthology.orchestra.run.trial106.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-20T02:24:23.254 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-20T02:24:23.257 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-20T02:24:23.258 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:23.263 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-20T02:24:23.265 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-20T02:24:23.276 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-20T02:24:23.281 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-20T02:24:23.297 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:23.297 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:23.305 INFO:teuthology.orchestra.run.trial106.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-20T02:24:23.308 INFO:teuthology.orchestra.run.trial106.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-20T02:24:23.315 INFO:teuthology.orchestra.run.trial106.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-20T02:24:23.339 INFO:teuthology.orchestra.run.trial106.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-20T02:24:23.390 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-20T02:24:23.402 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-20T02:24:23.405 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-20T02:24:23.409 INFO:teuthology.orchestra.run.trial106.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-20T02:24:23.414 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-20T02:24:23.419 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-20T02:24:23.422 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-20T02:24:23.436 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-20T02:24:23.457 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-20T02:24:23.461 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-20T02:24:23.466 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-20T02:24:23.477 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-20T02:24:23.486 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-20T02:24:23.492 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-20T02:24:23.511 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-20T02:24:23.520 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-20T02:24:23.574 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-20T02:24:23.585 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-20T02:24:23.601 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-20T02:24:23.605 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-20T02:24:23.613 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-20T02:24:23.652 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-20T02:24:23.715 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:23.716 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:23.972 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-20T02:24:23.981 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-20T02:24:23.985 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-20T02:24:23.991 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-20T02:24:23.992 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-20T02:24:24.020 INFO:teuthology.orchestra.run.trial106.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-20T02:24:24.063 INFO:teuthology.orchestra.run.trial106.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-20T02:24:24.069 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-20T02:24:24.073 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-20T02:24:24.078 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-20T02:24:24.082 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-20T02:24:24.089 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-20T02:24:24.093 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-20T02:24:24.121 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-20T02:24:24.131 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-20T02:24:24.165 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-20T02:24:24.182 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:24.184 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-20T02:24:24.215 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-20T02:24:24.221 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-20T02:24:24.242 INFO:teuthology.orchestra.run.trial098.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-20T02:24:24.248 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-20T02:24:24.281 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-20T02:24:24.291 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-20T02:24:24.296 INFO:teuthology.orchestra.run.trial098.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-20T02:24:24.299 INFO:teuthology.orchestra.run.trial098.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-20T02:24:24.303 INFO:teuthology.orchestra.run.trial098.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-20T02:24:24.327 INFO:teuthology.orchestra.run.trial098.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-20T02:24:24.340 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-20T02:24:24.343 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-20T02:24:24.349 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-20T02:24:24.351 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-20T02:24:24.362 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-20T02:24:24.368 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-20T02:24:24.390 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-20T02:24:24.392 INFO:teuthology.orchestra.run.trial098.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-20T02:24:24.396 INFO:teuthology.orchestra.run.trial098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-20T02:24:24.403 INFO:teuthology.orchestra.run.trial098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-20T02:24:24.414 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-20T02:24:24.417 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-20T02:24:24.427 INFO:teuthology.orchestra.run.trial098.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-20T02:24:24.476 INFO:teuthology.orchestra.run.trial106.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-20T02:24:24.478 INFO:teuthology.orchestra.run.trial106.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-20T02:24:24.479 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-20T02:24:24.492 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-20T02:24:24.494 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-20T02:24:24.498 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-20T02:24:24.499 INFO:teuthology.orchestra.run.trial098.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-20T02:24:24.505 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-20T02:24:24.509 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-20T02:24:24.512 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-20T02:24:24.527 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-20T02:24:24.548 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-20T02:24:24.553 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-20T02:24:24.558 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-20T02:24:24.569 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-20T02:24:24.578 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-20T02:24:24.584 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-20T02:24:24.604 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-20T02:24:24.613 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-20T02:24:24.669 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-20T02:24:24.681 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-20T02:24:24.696 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-20T02:24:24.701 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-20T02:24:24.709 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-20T02:24:24.749 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-20T02:24:24.823 INFO:teuthology.orchestra.run.trial106.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-20T02:24:24.896 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-20T02:24:25.078 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-20T02:24:25.088 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-20T02:24:25.092 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-20T02:24:25.098 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-20T02:24:25.099 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-20T02:24:25.128 INFO:teuthology.orchestra.run.trial098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-20T02:24:25.173 INFO:teuthology.orchestra.run.trial098.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-20T02:24:25.179 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-20T02:24:25.183 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-20T02:24:25.189 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-20T02:24:25.192 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-20T02:24:25.199 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-20T02:24:25.203 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-20T02:24:25.231 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-20T02:24:25.241 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-20T02:24:25.276 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-20T02:24:25.504 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-20T02:24:25.528 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-20T02:24:25.532 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-20T02:24:25.569 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-20T02:24:25.586 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-20T02:24:25.591 INFO:teuthology.orchestra.run.trial098.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-20T02:24:25.592 INFO:teuthology.orchestra.run.trial098.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-20T02:24:25.596 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-20T02:24:25.603 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-20T02:24:25.614 INFO:teuthology.orchestra.run.trial098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-20T02:24:25.616 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-20T02:24:25.631 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-20T02:24:25.707 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-20T02:24:25.715 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-20T02:24:25.739 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-20T02:24:25.768 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-20T02:24:25.819 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-20T02:24:25.824 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-20T02:24:25.828 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-20T02:24:25.829 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-20T02:24:25.847 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-20T02:24:25.847 INFO:teuthology.orchestra.run.trial106.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T02:24:25.847 INFO:teuthology.orchestra.run.trial106.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T02:24:25.848 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:25.855 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-20T02:24:25.879 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-20T02:24:25.879 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T02:24:25.880 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:25.914 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-20T02:24:25.945 INFO:teuthology.orchestra.run.trial098.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-20T02:24:25.977 INFO:teuthology.orchestra.run.trial106.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-20T02:24:25.979 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 85/99 2026-02-20T02:24:25.993 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 85/99 2026-02-20T02:24:25.993 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:25.993 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T02:24:25.993 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:26.019 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-20T02:24:26.698 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-20T02:24:26.704 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 86/99 2026-02-20T02:24:26.714 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-20T02:24:26.724 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-20T02:24:26.728 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 86/99 2026-02-20T02:24:26.729 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:26.729 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T02:24:26.729 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T02:24:26.729 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T02:24:26.729 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:26.731 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-20T02:24:26.745 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-20T02:24:26.760 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-20T02:24:26.786 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 87/99 2026-02-20T02:24:26.788 INFO:teuthology.orchestra.run.trial106.stdout: Installing : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 87/99 2026-02-20T02:24:26.793 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9. 88/99 2026-02-20T02:24:26.813 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9 89/99 2026-02-20T02:24:26.814 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 90/99 2026-02-20T02:24:26.837 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-20T02:24:26.845 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-20T02:24:26.869 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-20T02:24:26.900 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-20T02:24:26.951 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-20T02:24:26.957 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-20T02:24:26.961 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-20T02:24:26.962 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-20T02:24:26.980 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-20T02:24:26.981 INFO:teuthology.orchestra.run.trial098.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T02:24:26.981 INFO:teuthology.orchestra.run.trial098.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T02:24:26.981 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:26.988 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-20T02:24:27.014 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-20T02:24:27.014 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T02:24:27.014 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:27.052 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-20T02:24:27.116 INFO:teuthology.orchestra.run.trial098.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-20T02:24:27.118 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 85/99 2026-02-20T02:24:27.133 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 85/99 2026-02-20T02:24:27.133 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:27.133 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T02:24:27.133 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:27.306 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 90/99 2026-02-20T02:24:27.309 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noar 91/99 2026-02-20T02:24:27.767 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noar 91/99 2026-02-20T02:24:27.768 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35 92/99 2026-02-20T02:24:27.781 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35 92/99 2026-02-20T02:24:27.781 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noar 93/99 2026-02-20T02:24:27.833 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 86/99 2026-02-20T02:24:27.835 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noar 93/99 2026-02-20T02:24:27.859 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 86/99 2026-02-20T02:24:27.860 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:27.860 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T02:24:27.860 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T02:24:27.860 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T02:24:27.860 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:27.885 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.n 94/99 2026-02-20T02:24:27.886 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 95/99 2026-02-20T02:24:27.908 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 95/99 2026-02-20T02:24:27.908 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:27.908 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T02:24:27.908 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T02:24:27.908 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T02:24:27.908 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:27.914 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 87/99 2026-02-20T02:24:27.916 INFO:teuthology.orchestra.run.trial098.stdout: Installing : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 87/99 2026-02-20T02:24:27.920 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 96/99 2026-02-20T02:24:27.921 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9. 88/99 2026-02-20T02:24:27.941 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9 89/99 2026-02-20T02:24:27.942 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 90/99 2026-02-20T02:24:28.139 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 96/99 2026-02-20T02:24:28.141 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 97/99 2026-02-20T02:24:28.162 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 97/99 2026-02-20T02:24:28.163 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:28.163 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T02:24:28.163 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T02:24:28.163 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T02:24:28.163 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:28.266 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 98/99 2026-02-20T02:24:28.288 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 98/99 2026-02-20T02:24:28.289 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:28.289 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T02:24:28.289 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T02:24:28.289 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T02:24:28.289 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:28.307 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 99/99 2026-02-20T02:24:28.438 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 90/99 2026-02-20T02:24:28.441 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noar 91/99 2026-02-20T02:24:28.895 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noar 91/99 2026-02-20T02:24:28.896 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35 92/99 2026-02-20T02:24:28.908 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35 92/99 2026-02-20T02:24:28.908 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noar 93/99 2026-02-20T02:24:28.963 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 99/99 2026-02-20T02:24:28.963 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/99 2026-02-20T02:24:28.963 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/99 2026-02-20T02:24:28.963 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 3/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9 6/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 7/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noar 8/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35 9/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noar 10/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.n 11/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 12/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9. 13/99 2026-02-20T02:24:28.964 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 14/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 15/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-20T02:24:28.965 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-20T02:24:28.966 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-20T02:24:28.967 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-20T02:24:28.968 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-20T02:24:28.969 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-20T02:24:28.970 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-20T02:24:28.971 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-20T02:24:28.971 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-20T02:24:28.971 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-20T02:24:28.971 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-20T02:24:28.971 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-20T02:24:28.971 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-20T02:24:28.971 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-20T02:24:28.971 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noar 93/99 2026-02-20T02:24:29.016 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.n 94/99 2026-02-20T02:24:29.018 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 95/99 2026-02-20T02:24:29.026 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-20T02:24:29.026 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:29.026 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:29.026 INFO:teuthology.orchestra.run.trial106.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T02:24:29.026 INFO:teuthology.orchestra.run.trial106.stdout: ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:29.027 INFO:teuthology.orchestra.run.trial106.stdout: ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T02:24:29.028 INFO:teuthology.orchestra.run.trial106.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T02:24:29.029 INFO:teuthology.orchestra.run.trial106.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T02:24:29.030 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T02:24:29.031 INFO:teuthology.orchestra.run.trial106.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T02:24:29.032 INFO:teuthology.orchestra.run.trial106.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T02:24:29.033 INFO:teuthology.orchestra.run.trial106.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout: zip-3.0-35.el9.x86_64 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:29.034 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:29.039 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 95/99 2026-02-20T02:24:29.039 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:29.040 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T02:24:29.040 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T02:24:29.040 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T02:24:29.040 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:29.051 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 96/99 2026-02-20T02:24:29.082 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-base 2026-02-20T02:24:29.266 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 96/99 2026-02-20T02:24:29.268 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 97/99 2026-02-20T02:24:29.289 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 97/99 2026-02-20T02:24:29.289 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:29.289 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T02:24:29.289 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T02:24:29.289 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T02:24:29.289 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:29.390 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 98/99 2026-02-20T02:24:29.394 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:29.412 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 98/99 2026-02-20T02:24:29.412 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:29.412 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T02:24:29.412 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T02:24:29.412 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T02:24:29.412 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:29.430 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 99/99 2026-02-20T02:24:29.458 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:29.477 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:29.477 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:29.477 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:29.499 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install cephadm 2026-02-20T02:24:29.812 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:29.876 INFO:teuthology.orchestra.run.trial106.stdout:Package cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:29.894 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:29.895 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:29.895 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:29.916 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T02:24:30.114 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 99/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 3/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9 6/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 7/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noar 8/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35 9/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noar 10/99 2026-02-20T02:24:30.115 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.n 11/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 12/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9. 13/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 14/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 15/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-20T02:24:30.116 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-20T02:24:30.117 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-20T02:24:30.118 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-20T02:24:30.119 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-20T02:24:30.120 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-20T02:24:30.121 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-20T02:24:30.122 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-20T02:24:30.122 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-20T02:24:30.122 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-20T02:24:30.122 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-20T02:24:30.122 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-20T02:24:30.122 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-20T02:24:30.177 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-20T02:24:30.177 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.178 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T02:24:30.179 INFO:teuthology.orchestra.run.trial098.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T02:24:30.180 INFO:teuthology.orchestra.run.trial098.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T02:24:30.181 INFO:teuthology.orchestra.run.trial098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T02:24:30.182 INFO:teuthology.orchestra.run.trial098.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T02:24:30.183 INFO:teuthology.orchestra.run.trial098.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T02:24:30.184 INFO:teuthology.orchestra.run.trial098.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T02:24:30.185 INFO:teuthology.orchestra.run.trial098.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T02:24:30.186 INFO:teuthology.orchestra.run.trial098.stdout: zip-3.0-35.el9.x86_64 2026-02-20T02:24:30.186 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:30.186 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:30.222 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:30 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:30.232 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-base 2026-02-20T02:24:30.305 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:30.305 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:30.305 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-20T02:24:30.305 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:30.305 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:30.305 INFO:teuthology.orchestra.run.trial106.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 145 k 2026-02-20T02:24:30.306 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:30.306 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:30.306 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:30.306 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-20T02:24:30.306 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:30.306 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 145 k 2026-02-20T02:24:30.306 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 431 k 2026-02-20T02:24:30.306 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:30.391 INFO:teuthology.orchestra.run.trial106.stdout:ceph-immutable-object-cache-19.2.3-700.gf4ef35d 1.7 MB/s | 145 kB 00:00 2026-02-20T02:24:30.391 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:30.391 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-20T02:24:30.391 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:30.394 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:30.395 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:30.426 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:30.426 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:30.481 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:30.482 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.e 1/1 2026-02-20T02:24:30.504 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.e 1/1 2026-02-20T02:24:30.504 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:30.504 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T02:24:30.504 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:30.547 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:39 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:30.611 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:30.629 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:30.630 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:30.630 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:30.651 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install cephadm 2026-02-20T02:24:30.804 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.e 1/1 2026-02-20T02:24:30.804 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:30.804 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:30.804 INFO:teuthology.orchestra.run.trial106.stdout: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:30.804 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:30.804 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:30.830 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr 2026-02-20T02:24:30.960 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:39 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:31.024 INFO:teuthology.orchestra.run.trial098.stdout:Package cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:31.042 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:31.043 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:31.043 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:31.063 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T02:24:31.142 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:31 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:31.207 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:31.225 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:31.226 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:31.226 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:31.249 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T02:24:31.368 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:40 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:31.452 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:31.452 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:31.452 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 145 k 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 145 k 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 431 k 2026-02-20T02:24:31.453 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:31.538 INFO:teuthology.orchestra.run.trial098.stdout:ceph-immutable-object-cache-19.2.3-700.gf4ef35d 1.7 MB/s | 145 kB 00:00 2026-02-20T02:24:31.539 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:31.539 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-20T02:24:31.539 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:31.542 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:31.542 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:31.562 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:31 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:31.574 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:31.574 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:31.626 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:31.629 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:31.631 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.e 1/1 2026-02-20T02:24:31.645 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:31.646 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:31.646 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:31.653 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.e 1/1 2026-02-20T02:24:31.653 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:31.654 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T02:24:31.654 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:31.667 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T02:24:31.963 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.e 1/1 2026-02-20T02:24:31.964 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:31.964 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:31.964 INFO:teuthology.orchestra.run.trial098.stdout: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:31.964 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:31.965 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:31.978 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:31 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:31.991 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr 2026-02-20T02:24:32.043 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:32.062 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:32.062 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:32.063 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:32.083 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-rook 2026-02-20T02:24:32.301 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:41 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:32.365 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:32.383 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:32.383 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:32.384 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:32.390 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:32 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:32.405 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T02:24:32.455 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:32.473 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:32.474 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:32.474 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:32.495 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T02:24:32.716 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:41 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:32.781 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:32.800 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:32.800 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:32.800 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:32.810 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:32 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:32.822 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T02:24:32.875 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:32.893 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:32.894 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:32.894 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:32.916 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-fuse 2026-02-20T02:24:33.127 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:42 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:33.193 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:33.212 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:33.213 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:33.213 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:33.221 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:33 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:33.234 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-rook 2026-02-20T02:24:33.303 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:33.304 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:33.304 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-20T02:24:33.304 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:33.304 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:33.304 INFO:teuthology.orchestra.run.trial106.stdout: ceph-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.2 M 2026-02-20T02:24:33.305 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:33.305 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:33.305 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:33.305 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-20T02:24:33.305 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:33.305 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 1.2 M 2026-02-20T02:24:33.305 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 3.6 M 2026-02-20T02:24:33.305 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:33.423 INFO:teuthology.orchestra.run.trial106.stdout:ceph-fuse-19.2.3-700.gf4ef35d9.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2026-02-20T02:24:33.424 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:33.424 INFO:teuthology.orchestra.run.trial106.stdout:Total 9.6 MB/s | 1.2 MB 00:00 2026-02-20T02:24:33.424 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:33.427 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:33.427 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:33.461 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:33.462 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:33.538 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:42 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:33.562 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:33.580 INFO:teuthology.orchestra.run.trial106.stdout: Installing : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:33.603 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:33.622 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:33.622 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:33.623 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:33.643 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T02:24:33.804 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:33.861 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:33.861 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:33.861 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:33.861 INFO:teuthology.orchestra.run.trial106.stdout: ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:33.861 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:33.861 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:33.887 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install ceph-volume 2026-02-20T02:24:33.952 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:42 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:34.017 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:34.035 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:34.036 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:34.036 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:34.057 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-fuse 2026-02-20T02:24:34.194 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:34 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:34.259 INFO:teuthology.orchestra.run.trial106.stdout:Package ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:34.277 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:34.278 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:34.278 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:34.299 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librados-devel 2026-02-20T02:24:34.364 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:43 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:34.449 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:34.450 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:34.450 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-20T02:24:34.450 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:34.450 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:34.450 INFO:teuthology.orchestra.run.trial098.stdout: ceph-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.2 M 2026-02-20T02:24:34.451 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:34.451 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:34.451 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:34.451 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-20T02:24:34.451 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:34.451 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 1.2 M 2026-02-20T02:24:34.451 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 3.6 M 2026-02-20T02:24:34.451 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:34.571 INFO:teuthology.orchestra.run.trial098.stdout:ceph-fuse-19.2.3-700.gf4ef35d9.el9.x86_64.rpm 9.5 MB/s | 1.2 MB 00:00 2026-02-20T02:24:34.571 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:34.572 INFO:teuthology.orchestra.run.trial098.stdout:Total 9.5 MB/s | 1.2 MB 00:00 2026-02-20T02:24:34.572 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:34.575 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:34.575 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:34.604 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:34 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:34.609 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:34.609 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:34.688 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:34.688 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout: librados-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 126 k 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:34.689 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 126 k 2026-02-20T02:24:34.690 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 456 k 2026-02-20T02:24:34.690 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:34.709 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:34.726 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:34.775 INFO:teuthology.orchestra.run.trial106.stdout:librados-devel-19.2.3-700.gf4ef35d9.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-20T02:24:34.776 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:34.776 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-20T02:24:34.776 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:34.778 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:34.778 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:34.811 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:34.811 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:34.866 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:34.882 INFO:teuthology.orchestra.run.trial106.stdout: Installing : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:34.967 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:34.973 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:35.023 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:35.023 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:35.024 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:35.024 INFO:teuthology.orchestra.run.trial098.stdout: ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:35.024 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:35.024 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:35.032 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:35.032 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:35.032 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:35.032 INFO:teuthology.orchestra.run.trial106.stdout: librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:35.032 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:35.032 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:35.050 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-volume 2026-02-20T02:24:35.059 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install libcephfs2 2026-02-20T02:24:35.359 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:44 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:35.365 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:35 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:35.424 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch is already installed. 2026-02-20T02:24:35.431 INFO:teuthology.orchestra.run.trial106.stdout:Package libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:35.442 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:35.443 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:35.443 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:35.450 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:35.451 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:35.451 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:35.464 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librados-devel 2026-02-20T02:24:35.472 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install libcephfs-devel 2026-02-20T02:24:35.775 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:44 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:35.781 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:35 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:35.859 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:35.860 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:35.860 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-20T02:24:35.860 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout: librados-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 126 k 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 126 k 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 456 k 2026-02-20T02:24:35.861 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:35.864 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:35.865 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:35.865 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 34 k 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:35.866 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 34 k 2026-02-20T02:24:35.867 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 153 k 2026-02-20T02:24:35.867 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:35.929 INFO:teuthology.orchestra.run.trial106.stdout:libcephfs-devel-19.2.3-700.gf4ef35d9.el9.x86_64 532 kB/s | 34 kB 00:00 2026-02-20T02:24:35.930 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:35.930 INFO:teuthology.orchestra.run.trial106.stdout:Total 524 kB/s | 34 kB 00:00 2026-02-20T02:24:35.930 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:35.931 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:35.931 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:35.934 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:35.934 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:35.945 INFO:teuthology.orchestra.run.trial098.stdout:librados-devel-19.2.3-700.gf4ef35d9.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-20T02:24:35.945 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:35.945 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.5 MB/s | 126 kB 00:00 2026-02-20T02:24:35.945 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:35.948 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:35.948 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:35.955 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:35.971 INFO:teuthology.orchestra.run.trial106.stdout: Installing : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:35.980 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:35.981 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:36.026 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:36.035 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:36.052 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:36.083 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:36.083 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:36.083 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:36.083 INFO:teuthology.orchestra.run.trial106.stdout: libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:36.083 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:36.084 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:36.109 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librados2 2026-02-20T02:24:36.139 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:36.199 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:36.199 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:36.199 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:36.199 INFO:teuthology.orchestra.run.trial098.stdout: librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:36.199 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:36.199 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:36.225 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install libcephfs2 2026-02-20T02:24:36.417 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:36 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:36.480 INFO:teuthology.orchestra.run.trial106.stdout:Package librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:36.499 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:36.499 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:36.499 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:36.520 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install librbd1 2026-02-20T02:24:36.537 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:45 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:36.602 INFO:teuthology.orchestra.run.trial098.stdout:Package libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:36.621 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:36.621 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:36.621 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:36.642 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install libcephfs-devel 2026-02-20T02:24:36.831 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:36 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:36.895 INFO:teuthology.orchestra.run.trial106.stdout:Package librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:36.913 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:36.914 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:36.914 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:36.935 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rados 2026-02-20T02:24:36.954 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:45 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 34 k 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-20T02:24:37.038 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:37.039 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 34 k 2026-02-20T02:24:37.039 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 153 k 2026-02-20T02:24:37.039 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:37.103 INFO:teuthology.orchestra.run.trial098.stdout:libcephfs-devel-19.2.3-700.gf4ef35d9.el9.x86_64 527 kB/s | 34 kB 00:00 2026-02-20T02:24:37.103 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:37.103 INFO:teuthology.orchestra.run.trial098.stdout:Total 521 kB/s | 34 kB 00:00 2026-02-20T02:24:37.103 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:37.105 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:37.105 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:37.108 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:37.108 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:37.131 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:37.148 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:37.204 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:37.241 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:37 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:37.261 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:37.262 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:37.262 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:37.262 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:37.262 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:37.262 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:37.292 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librados2 2026-02-20T02:24:37.307 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:37.326 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:37.326 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:37.326 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:37.347 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rgw 2026-02-20T02:24:37.610 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:46 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:37.656 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:37 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:37.674 INFO:teuthology.orchestra.run.trial098.stdout:Package librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:37.693 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:37.693 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:37.693 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:37.715 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librbd1 2026-02-20T02:24:37.722 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:37.741 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:37.742 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:37.742 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:37.763 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-cephfs 2026-02-20T02:24:38.027 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:47 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:38.067 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:38 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:38.091 INFO:teuthology.orchestra.run.trial098.stdout:Package librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:38.111 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:38.112 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:38.112 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:38.131 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:38.134 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rados 2026-02-20T02:24:38.150 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:38.150 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:38.151 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:38.172 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install python3-rbd 2026-02-20T02:24:38.443 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:47 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:38.481 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:38 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:38.509 INFO:teuthology.orchestra.run.trial098.stdout:Package python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:38.527 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:38.528 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:38.528 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:38.546 INFO:teuthology.orchestra.run.trial106.stdout:Package python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:38.549 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rgw 2026-02-20T02:24:38.565 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:38.565 INFO:teuthology.orchestra.run.trial106.stdout:Nothing to do. 2026-02-20T02:24:38.565 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:38.587 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-fuse 2026-02-20T02:24:38.861 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:47 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:38.898 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:38 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:38.927 INFO:teuthology.orchestra.run.trial098.stdout:Package python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:38.945 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:38.946 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:38.946 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:38.968 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-cephfs 2026-02-20T02:24:38.980 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:38.981 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:38.981 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-20T02:24:38.981 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:38.981 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:38.981 INFO:teuthology.orchestra.run.trial106.stdout: rbd-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 85 k 2026-02-20T02:24:38.981 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:38.981 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:38.981 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:38.982 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-20T02:24:38.982 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:38.982 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 85 k 2026-02-20T02:24:38.982 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 227 k 2026-02-20T02:24:38.982 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:39.055 INFO:teuthology.orchestra.run.trial106.stdout:rbd-fuse-19.2.3-700.gf4ef35d9.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-20T02:24:39.056 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:39.056 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-20T02:24:39.056 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:39.059 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:39.060 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:39.090 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:39.091 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:39.141 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:39.158 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:39.243 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:39.279 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:48 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:39.301 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:39.302 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:39.302 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:39.302 INFO:teuthology.orchestra.run.trial106.stdout: rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:39.302 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:39.302 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:39.330 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-mirror 2026-02-20T02:24:39.344 INFO:teuthology.orchestra.run.trial098.stdout:Package python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:39.362 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:39.363 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:39.363 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:39.385 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rbd 2026-02-20T02:24:39.641 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:39 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:39.694 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:48 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:39.726 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout: Package Arch Version Repo Size 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout: rbd-mirror x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.1 M 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-20T02:24:39.727 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:39.728 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 3.1 M 2026-02-20T02:24:39.728 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 13 M 2026-02-20T02:24:39.728 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:39.760 INFO:teuthology.orchestra.run.trial098.stdout:Package python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 is already installed. 2026-02-20T02:24:39.778 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:39.779 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-20T02:24:39.779 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:39.800 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-fuse 2026-02-20T02:24:39.879 INFO:teuthology.orchestra.run.trial106.stdout:rbd-mirror-19.2.3-700.gf4ef35d9.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-20T02:24:39.879 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:39.879 INFO:teuthology.orchestra.run.trial106.stdout:Total 20 MB/s | 3.1 MB 00:00 2026-02-20T02:24:39.880 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:39.883 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:39.883 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:39.924 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:39.924 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:40.117 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:49 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:40.119 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:40.120 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:40.143 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:40.143 INFO:teuthology.orchestra.run.trial106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:40.144 INFO:teuthology.orchestra.run.trial106.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T02:24:40.144 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T02:24:40.144 INFO:teuthology.orchestra.run.trial106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T02:24:40.144 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:40.200 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:40.201 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:40.201 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-20T02:24:40.201 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:40.201 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:40.201 INFO:teuthology.orchestra.run.trial098.stdout: rbd-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 85 k 2026-02-20T02:24:40.201 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:40.201 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:40.201 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:40.202 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-20T02:24:40.202 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:40.202 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 85 k 2026-02-20T02:24:40.202 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 227 k 2026-02-20T02:24:40.202 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:40.275 INFO:teuthology.orchestra.run.trial098.stdout:rbd-fuse-19.2.3-700.gf4ef35d9.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-20T02:24:40.275 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:40.275 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-20T02:24:40.275 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:40.278 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:40.278 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:40.309 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:40.309 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:40.361 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:40.378 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:40.458 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:40.458 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:40.458 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:40.458 INFO:teuthology.orchestra.run.trial106.stdout: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:40.459 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:40.459 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:40.459 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:40.488 DEBUG:teuthology.orchestra.run.trial106:> sudo yum -y install rbd-nbd 2026-02-20T02:24:40.515 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:40.515 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:40.515 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:40.515 INFO:teuthology.orchestra.run.trial098.stdout: rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:40.515 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:40.516 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:40.543 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-mirror 2026-02-20T02:24:40.805 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:00:40 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:24:40.852 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:49 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:40.887 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:24:40.888 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:40.888 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout: rbd-nbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 170 k 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout:Install 1 Package 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 170 k 2026-02-20T02:24:40.889 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 490 k 2026-02-20T02:24:40.890 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:24:40.935 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:40.936 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:40.936 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-20T02:24:40.936 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:40.936 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:40.936 INFO:teuthology.orchestra.run.trial098.stdout: rbd-mirror x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.1 M 2026-02-20T02:24:40.936 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:40.937 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:40.937 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:40.937 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-20T02:24:40.937 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:40.937 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 3.1 M 2026-02-20T02:24:40.937 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 13 M 2026-02-20T02:24:40.937 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:40.974 INFO:teuthology.orchestra.run.trial106.stdout:rbd-nbd-19.2.3-700.gf4ef35d9.el9.x86_64.rpm 2.0 MB/s | 170 kB 00:00 2026-02-20T02:24:40.974 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:40.975 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.9 MB/s | 170 kB 00:00 2026-02-20T02:24:40.975 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:24:40.978 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:24:40.978 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:24:41.010 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:24:41.010 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:24:41.067 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:24:41.084 INFO:teuthology.orchestra.run.trial106.stdout: Installing : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:41.085 INFO:teuthology.orchestra.run.trial098.stdout:rbd-mirror-19.2.3-700.gf4ef35d9.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-20T02:24:41.086 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:41.086 INFO:teuthology.orchestra.run.trial098.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-20T02:24:41.086 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:41.090 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:41.090 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:41.130 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:41.131 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:41.167 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:41.226 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:41.226 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:41.226 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:24:41.226 INFO:teuthology.orchestra.run.trial106.stdout: rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:41.226 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:24:41.226 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:24:41.257 DEBUG:teuthology.parallel:result is None 2026-02-20T02:24:41.324 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:41.325 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:41.349 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:41.349 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T02:24:41.349 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T02:24:41.349 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T02:24:41.349 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T02:24:41.350 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:41.674 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:41.674 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:41.675 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:41.675 INFO:teuthology.orchestra.run.trial098.stdout: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:41.675 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:41.675 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:41.703 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-nbd 2026-02-20T02:24:42.014 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:51 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:24:42.097 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:24:42.097 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:42.097 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-20T02:24:42.097 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:42.097 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout: rbd-nbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 170 k 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 170 k 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 490 k 2026-02-20T02:24:42.098 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:24:42.184 INFO:teuthology.orchestra.run.trial098.stdout:rbd-nbd-19.2.3-700.gf4ef35d9.el9.x86_64.rpm 1.9 MB/s | 170 kB 00:00 2026-02-20T02:24:42.185 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:42.185 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.9 MB/s | 170 kB 00:00 2026-02-20T02:24:42.185 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:24:42.188 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:24:42.189 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:24:42.221 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:24:42.221 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:24:42.277 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:24:42.294 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:42.374 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:42.432 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/1 2026-02-20T02:24:42.432 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:42.432 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:24:42.432 INFO:teuthology.orchestra.run.trial098.stdout: rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T02:24:42.433 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:42.433 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:24:42.464 DEBUG:teuthology.parallel:result is None 2026-02-20T02:24:42.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:24:42.628 DEBUG:teuthology.orchestra.run.trial098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T02:24:42.649 INFO:teuthology.orchestra.run.trial098.stdout:19.2.3-700.gf4ef35d9.el9 2026-02-20T02:24:42.649 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-700.gf4ef35d9.el9 2026-02-20T02:24:42.649 INFO:teuthology.task.install:The correct ceph version 19.2.3-700.gf4ef35d9 is installed. 2026-02-20T02:24:42.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:24:42.795 DEBUG:teuthology.orchestra.run.trial106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T02:24:42.816 INFO:teuthology.orchestra.run.trial106.stdout:19.2.3-700.gf4ef35d9.el9 2026-02-20T02:24:42.816 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-700.gf4ef35d9.el9 2026-02-20T02:24:42.817 INFO:teuthology.task.install:The correct ceph version 19.2.3-700.gf4ef35d9 is installed. 2026-02-20T02:24:42.819 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T02:24:42.819 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:24:42.819 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T02:24:42.845 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:24:42.845 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T02:24:42.881 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T02:24:42.882 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:24:42.882 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T02:24:42.911 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T02:24:42.975 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:24:42.975 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T02:24:43.001 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T02:24:43.066 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T02:24:43.067 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:24:43.067 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T02:24:43.093 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T02:24:43.156 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:24:43.157 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T02:24:43.182 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T02:24:43.245 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T02:24:43.245 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:24:43.246 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T02:24:43.271 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T02:24:43.336 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:24:43.336 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T02:24:43.362 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T02:24:43.426 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-20T02:24:43.553 INFO:tasks.cephadm:Config: {'roleless': True, 'cluster-conf': {'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering'], 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03'} 2026-02-20T02:24:43.554 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:24:43.556 INFO:tasks.cephadm:Cluster fsid is 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:43.556 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-20T02:24:43.556 INFO:tasks.cephadm:No mon roles; fabricating mons 2026-02-20T02:24:43.556 INFO:tasks.cephadm:Monitor IPs: {'mon.trial098': '10.20.193.98', 'mon.trial106': '10.20.193.106'} 2026-02-20T02:24:43.556 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-20T02:24:43.556 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname $(hostname -s) 2026-02-20T02:24:43.582 DEBUG:teuthology.orchestra.run.trial106:> sudo hostname $(hostname -s) 2026-02-20T02:24:43.607 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-20T02:24:43.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:24:43.734 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/', 'ref': 'wip-jcollin-testing-20260218.004834-squid', 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-18 01:49:27.821377', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-700-gf4ef35d9', 'package_manager_version': '19.2.3-700.gf4ef35d9', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3045/', 'root_build_cause': '', 'node_name': '10.20.192.25+soko15', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-20T02:24:43.875 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-jcollin-testing-20260218.004834-squid, sha1 f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:24:43.877 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm 2026-02-20T02:24:43.877 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm 2026-02-20T02:24:43.877 DEBUG:teuthology.orchestra.run.trial098:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-20T02:24:44.159 INFO:teuthology.orchestra.run.trial098.stdout:-rw-r--r--. 1 ubuntu ubuntu 788264 Feb 20 02:24 /home/ubuntu/cephtest/cephadm 2026-02-20T02:24:44.160 DEBUG:teuthology.orchestra.run.trial106:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-20T02:24:44.417 INFO:teuthology.orchestra.run.trial106.stdout:-rw-r--r--. 1 ubuntu ubuntu 788264 Feb 20 02:24 /home/ubuntu/cephtest/cephadm 2026-02-20T02:24:44.417 DEBUG:teuthology.orchestra.run.trial098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-20T02:24:44.436 DEBUG:teuthology.orchestra.run.trial106:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-20T02:24:44.471 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 on all hosts... 2026-02-20T02:24:44.471 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 pull 2026-02-20T02:24:44.478 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 pull 2026-02-20T02:24:44.716 INFO:teuthology.orchestra.run.trial098.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T02:24:44.734 INFO:teuthology.orchestra.run.trial106.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T02:24:53.642 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-20T02:24:53.642 INFO:teuthology.orchestra.run.trial106.stdout: "ceph_version": "ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable)", 2026-02-20T02:24:53.642 INFO:teuthology.orchestra.run.trial106.stdout: "image_id": "de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7", 2026-02-20T02:24:53.642 INFO:teuthology.orchestra.run.trial106.stdout: "repo_digests": [ 2026-02-20T02:24:53.642 INFO:teuthology.orchestra.run.trial106.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285" 2026-02-20T02:24:53.642 INFO:teuthology.orchestra.run.trial106.stdout: ] 2026-02-20T02:24:53.643 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-20T02:24:53.690 INFO:teuthology.orchestra.run.trial098.stdout:{ 2026-02-20T02:24:53.691 INFO:teuthology.orchestra.run.trial098.stdout: "ceph_version": "ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable)", 2026-02-20T02:24:53.691 INFO:teuthology.orchestra.run.trial098.stdout: "image_id": "de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7", 2026-02-20T02:24:53.691 INFO:teuthology.orchestra.run.trial098.stdout: "repo_digests": [ 2026-02-20T02:24:53.691 INFO:teuthology.orchestra.run.trial098.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285" 2026-02-20T02:24:53.691 INFO:teuthology.orchestra.run.trial098.stdout: ] 2026-02-20T02:24:53.691 INFO:teuthology.orchestra.run.trial098.stdout:} 2026-02-20T02:24:53.706 DEBUG:teuthology.orchestra.run.trial098:> sudo mkdir -p /etc/ceph 2026-02-20T02:24:53.771 DEBUG:teuthology.orchestra.run.trial106:> sudo mkdir -p /etc/ceph 2026-02-20T02:24:53.801 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod 777 /etc/ceph 2026-02-20T02:24:53.825 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 777 /etc/ceph 2026-02-20T02:24:53.865 INFO:tasks.cephadm:Writing seed config... 2026-02-20T02:24:53.867 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2026-02-20T02:24:53.867 INFO:tasks.cephadm: override: [client] debug client = 20 2026-02-20T02:24:53.867 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-02-20T02:24:53.867 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2026-02-20T02:24:53.867 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2026-02-20T02:24:53.867 INFO:tasks.cephadm: override: [mds] debug mds = 20 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] debug ms = 1 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-20T02:24:53.868 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-20T02:24:53.869 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-20T02:24:53.869 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-20T02:24:53.869 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-20T02:24:53.869 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2026-02-20T02:24:53.869 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-20T02:24:53.869 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-20T02:24:53.869 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2026-02-20T02:24:53.869 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-20T02:24:53.870 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:24:53.871 DEBUG:teuthology.orchestra.run.trial098:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-20T02:24:53.887 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5138774d-0e03-11f1-8edf-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2026-02-20T02:24:53.887 DEBUG:teuthology.orchestra.run.trial098:mon.trial098> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial098.service 2026-02-20T02:24:53.929 INFO:tasks.cephadm:Bootstrapping... 2026-02-20T02:24:53.929 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 -v bootstrap --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 10.20.193.98 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-20T02:24:54.065 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:24:54.065 INFO:teuthology.orchestra.run.trial098.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', '-v', 'bootstrap', '--fsid', '5138774d-0e03-11f1-8edf-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '10.20.193.98', '--skip-admin-label'] 2026-02-20T02:24:54.065 INFO:teuthology.orchestra.run.trial098.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-20T02:24:54.066 INFO:teuthology.orchestra.run.trial098.stdout:Verifying podman|docker is present... 2026-02-20T02:24:54.081 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stdout 5.6.0 2026-02-20T02:24:54.081 INFO:teuthology.orchestra.run.trial098.stdout:Verifying lvm2 is present... 2026-02-20T02:24:54.082 INFO:teuthology.orchestra.run.trial098.stdout:Verifying time synchronization is in place... 2026-02-20T02:24:54.088 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-20T02:24:54.088 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-20T02:24:54.093 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-20T02:24:54.093 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout inactive 2026-02-20T02:24:54.099 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout enabled 2026-02-20T02:24:54.105 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout active 2026-02-20T02:24:54.105 INFO:teuthology.orchestra.run.trial098.stdout:Unit chronyd.service is enabled and running 2026-02-20T02:24:54.105 INFO:teuthology.orchestra.run.trial098.stdout:Repeating the final host check... 2026-02-20T02:24:54.121 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stdout 5.6.0 2026-02-20T02:24:54.121 INFO:teuthology.orchestra.run.trial098.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-20T02:24:54.121 INFO:teuthology.orchestra.run.trial098.stdout:systemctl is present 2026-02-20T02:24:54.121 INFO:teuthology.orchestra.run.trial098.stdout:lvcreate is present 2026-02-20T02:24:54.126 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-20T02:24:54.126 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-20T02:24:54.131 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-20T02:24:54.131 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout inactive 2026-02-20T02:24:54.137 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout enabled 2026-02-20T02:24:54.143 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout active 2026-02-20T02:24:54.143 INFO:teuthology.orchestra.run.trial098.stdout:Unit chronyd.service is enabled and running 2026-02-20T02:24:54.143 INFO:teuthology.orchestra.run.trial098.stdout:Host looks OK 2026-02-20T02:24:54.143 INFO:teuthology.orchestra.run.trial098.stdout:Cluster fsid: 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:54.143 INFO:teuthology.orchestra.run.trial098.stdout:Acquiring lock 139959288323040 on /run/cephadm/5138774d-0e03-11f1-8edf-d404e6e7d460.lock 2026-02-20T02:24:54.143 INFO:teuthology.orchestra.run.trial098.stdout:Lock 139959288323040 acquired on /run/cephadm/5138774d-0e03-11f1-8edf-d404e6e7d460.lock 2026-02-20T02:24:54.143 INFO:teuthology.orchestra.run.trial098.stdout:Verifying IP 10.20.193.98 port 3300 ... 2026-02-20T02:24:54.144 INFO:teuthology.orchestra.run.trial098.stdout:Verifying IP 10.20.193.98 port 6789 ... 2026-02-20T02:24:54.144 INFO:teuthology.orchestra.run.trial098.stdout:Base mon IP(s) is [10.20.193.98:3300, 10.20.193.98:6789], mon addrv is [v2:10.20.193.98:3300,v1:10.20.193.98:6789] 2026-02-20T02:24:54.146 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.98 metric 102 2026-02-20T02:24:54.147 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.98 metric 102 2026-02-20T02:24:54.147 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-20T02:24:54.149 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-20T02:24:54.149 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-20T02:24:54.149 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-20T02:24:54.152 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-20T02:24:54.152 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout inet6 fe80::407e:a9b9:1a53:2a73/64 scope link noprefixroute 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:61ec/64 scope link 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:Mon IP `10.20.193.98` is in CIDR network `10.20.192.0/20` 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:Mon IP `10.20.193.98` is in CIDR network `10.20.192.0/20` 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-20T02:24:54.153 INFO:teuthology.orchestra.run.trial098.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T02:24:54.411 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stdout de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 2026-02-20T02:24:54.411 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T02:24:54.411 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stderr Getting image source signatures 2026-02-20T02:24:54.411 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stderr Copying blob sha256:6d3e06557248500de3ee1d1978b6f44f0216e6134918a5dff185eb84966415de 2026-02-20T02:24:54.411 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stderr Copying blob sha256:5dd85e1a50663785d86adae5ef92579a03e6f64059ca9c005010518acdd62048 2026-02-20T02:24:54.411 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stderr Copying config sha256:de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 2026-02-20T02:24:54.411 INFO:teuthology.orchestra.run.trial098.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-20T02:24:54.530 INFO:teuthology.orchestra.run.trial098.stdout:ceph: stdout ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable) 2026-02-20T02:24:54.530 INFO:teuthology.orchestra.run.trial098.stdout:Ceph version: ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable) 2026-02-20T02:24:54.530 INFO:teuthology.orchestra.run.trial098.stdout:Extracting ceph user uid/gid from container image... 2026-02-20T02:24:54.660 INFO:teuthology.orchestra.run.trial098.stdout:stat: stdout 167 167 2026-02-20T02:24:54.674 INFO:teuthology.orchestra.run.trial098.stdout:Creating initial keys... 2026-02-20T02:24:54.789 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph-authtool: stdout AQD2xZdpLgNRLhAA3l4kycEItwan42uig7TDlg== 2026-02-20T02:24:54.933 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph-authtool: stdout AQD2xZdpS3bbNhAAh5ZyT308hm9IKWASnBBtBg== 2026-02-20T02:24:55.060 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph-authtool: stdout AQD3xZdphezbAhAAJZ2qFPg/W6arCNUwTdVnuQ== 2026-02-20T02:24:55.060 INFO:teuthology.orchestra.run.trial098.stdout:Creating initial monmap... 2026-02-20T02:24:55.204 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout:monmaptool for trial098 [v2:10.20.193.98:3300,v1:10.20.193.98:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout:setting min_mon_release = quincy 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/monmaptool: set fsid to 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:24:55.205 INFO:teuthology.orchestra.run.trial098.stdout:Creating mon... 2026-02-20T02:24:55.341 INFO:teuthology.orchestra.run.trial098.stdout:create mon.trial098 on 2026-02-20T02:24:55.498 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-20T02:24:55.601 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-20T02:24:55.718 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460.target → /etc/systemd/system/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460.target. 2026-02-20T02:24:55.719 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460.target → /etc/systemd/system/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460.target. 2026-02-20T02:24:55.845 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial098 2026-02-20T02:24:55.845 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial098.service: Unit ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial098.service not loaded. 2026-02-20T02:24:55.977 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460.target.wants/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial098.service → /etc/systemd/system/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@.service. 2026-02-20T02:24:56.115 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 podman[38457]: 2026-02-20 02:24:56.078507788 +0000 UTC m=+0.015266583 container create 7f7d2ec03073f81afee7dd25b8cf5eb0c31034409be90e0da9558a1e0bd87043 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T02:24:56.132 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T02:24:56.133 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout disabled 2026-02-20T02:24:56.139 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T02:24:56.139 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout inactive 2026-02-20T02:24:56.140 INFO:teuthology.orchestra.run.trial098.stdout:firewalld.service is not enabled 2026-02-20T02:24:56.140 INFO:teuthology.orchestra.run.trial098.stdout:Not possible to enable service . firewalld.service is not available 2026-02-20T02:24:56.140 INFO:teuthology.orchestra.run.trial098.stdout:Waiting for mon to start... 2026-02-20T02:24:56.140 INFO:teuthology.orchestra.run.trial098.stdout:Waiting for mon... 2026-02-20T02:24:56.317 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout cluster: 2026-02-20T02:24:56.317 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout id: 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:56.317 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout services: 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum trial098 (age 0.135615s) 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout data: 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-20T02:24:56.318 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout pgs: 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.243+0000 7f8309d41640 1 Processor -- start 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.243+0000 7f8309d41640 1 -- start start 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.243+0000 7f8309d41640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f8304109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.243+0000 7f8309d41640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f830410a250 con 0x7f8304109880 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.243+0000 7f83037fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f8304109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.243+0000 7f83037fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f8304109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36860/0 (socket says 10.20.193.98:36860) 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.243+0000 7f83037fe640 1 -- 10.20.193.98:0/3286137406 learned_addr learned my addr 10.20.193.98:0/3286137406 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.244+0000 7f83037fe640 1 -- 10.20.193.98:0/3286137406 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830410aa80 con 0x7f8304109880 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f83037fe640 1 --2- 10.20.193.98:0/3286137406 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f8304109c80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009920 tx=0x7f82f002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3d523ebed0b60 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:56.319 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f83027fc640 1 -- 10.20.193.98:0/3286137406 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f82f003c070 con 0x7f8304109880 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f83027fc640 1 -- 10.20.193.98:0/3286137406 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f002f9b0 con 0x7f8304109880 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f83027fc640 1 -- 10.20.193.98:0/3286137406 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f82f002fcd0 con 0x7f8304109880 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f8309d41640 1 -- 10.20.193.98:0/3286137406 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 msgr2=0x7f8304109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f8309d41640 1 --2- 10.20.193.98:0/3286137406 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f8304109c80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009920 tx=0x7f82f002ef20 comp rx=0 tx=0).stop 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f8309d41640 1 -- 10.20.193.98:0/3286137406 shutdown_connections 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f8309d41640 1 --2- 10.20.193.98:0/3286137406 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f8304109c80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f8309d41640 1 -- 10.20.193.98:0/3286137406 >> 10.20.193.98:0/3286137406 conn(0x7f830407ce10 msgr2=0x7f830407d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f8309d41640 1 -- 10.20.193.98:0/3286137406 shutdown_connections 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f8309d41640 1 -- 10.20.193.98:0/3286137406 wait complete. 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.245+0000 7f8309d41640 1 Processor -- start 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8309d41640 1 -- start start 2026-02-20T02:24:56.320 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8309d41640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f830419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8309d41640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f830410afb0 con 0x7f8304109880 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f83037fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f830419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f83037fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f830419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36872/0 (socket says 10.20.193.98:36872) 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f83037fe640 1 -- 10.20.193.98:0/747529529 learned_addr learned my addr 10.20.193.98:0/747529529 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f83037fe640 1 -- 10.20.193.98:0/747529529 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830419f420 con 0x7f8304109880 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f83037fe640 1 --2- 10.20.193.98:0/747529529 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f830419eee0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009a50 tx=0x7f82f00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8300ff9640 1 -- 10.20.193.98:0/747529529 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f82f0043410 con 0x7f8304109880 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8300ff9640 1 -- 10.20.193.98:0/747529529 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0048070 con 0x7f8304109880 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830419f6b0 con 0x7f8304109880 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8300ff9640 1 -- 10.20.193.98:0/747529529 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f82f0043760 con 0x7f8304109880 2026-02-20T02:24:56.321 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83041a23a0 con 0x7f8304109880 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8300ff9640 1 -- 10.20.193.98:0/747529529 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f82f0043900 con 0x7f8304109880 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.246+0000 7f8300ff9640 1 -- 10.20.193.98:0/747529529 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f82f004da40 con 0x7f8304109880 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.247+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830410b670 con 0x7f8304109880 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.248+0000 7f8300ff9640 1 -- 10.20.193.98:0/747529529 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f82f0040050 con 0x7f8304109880 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.276+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f83041981a0 con 0x7f8304109880 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.276+0000 7f8300ff9640 1 -- 10.20.193.98:0/747529529 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+324 (secure 0 0 0) 0x7f82f004d460 con 0x7f8304109880 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.277+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 msgr2=0x7f830419eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.277+0000 7f8309d41640 1 --2- 10.20.193.98:0/747529529 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f830419eee0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009a50 tx=0x7f82f00047c0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.277+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 shutdown_connections 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.277+0000 7f8309d41640 1 --2- 10.20.193.98:0/747529529 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8304109880 0x7f830419eee0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.322 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.277+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 >> 10.20.193.98:0/747529529 conn(0x7f830407ce10 msgr2=0x7f83041931d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:56.323 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.277+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 shutdown_connections 2026-02-20T02:24:56.323 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.277+0000 7f8309d41640 1 -- 10.20.193.98:0/747529529 wait complete. 2026-02-20T02:24:56.323 INFO:teuthology.orchestra.run.trial098.stdout:mon is available 2026-02-20T02:24:56.323 INFO:teuthology.orchestra.run.trial098.stdout:Assimilating anything we can from ceph.conf... 2026-02-20T02:24:56.367 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 podman[38457]: 2026-02-20 02:24:56.116586322 +0000 UTC m=+0.053345127 container init 7f7d2ec03073f81afee7dd25b8cf5eb0c31034409be90e0da9558a1e0bd87043 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2026-02-20T02:24:56.367 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 podman[38457]: 2026-02-20 02:24:56.118929746 +0000 UTC m=+0.055688541 container start 7f7d2ec03073f81afee7dd25b8cf5eb0c31034409be90e0da9558a1e0bd87043 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T02:24:56.367 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 bash[38457]: 7f7d2ec03073f81afee7dd25b8cf5eb0c31034409be90e0da9558a1e0bd87043 2026-02-20T02:24:56.368 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 podman[38457]: 2026-02-20 02:24:56.07250476 +0000 UTC m=+0.009263575 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:24:56.368 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 systemd[1]: Started Ceph mon.trial098 for 5138774d-0e03-11f1-8edf-d404e6e7d460. 2026-02-20T02:24:56.368 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 ceph-mon[38487]: mkfs 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:56.368 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 ceph-mon[38487]: mon.trial098 is new leader, mons trial098 in quorum (ranks 0) 2026-02-20T02:24:56.474 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:24:56.474 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout [global] 2026-02-20T02:24:56.474 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout fsid = 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:56.474 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-20T02:24:56.475 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.98:3300,v1:10.20.193.98:6789] 2026-02-20T02:24:56.475 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-20T02:24:56.475 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-20T02:24:56.475 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-20T02:24:56.475 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-20T02:24:56.475 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:24:56.475 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-20T02:24:56.475 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-20T02:24:56.476 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:24:56.476 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout [osd] 2026-02-20T02:24:56.476 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-20T02:24:56.476 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-20T02:24:56.476 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.410+0000 7ff2cb8cf640 1 Processor -- start 2026-02-20T02:24:56.476 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.410+0000 7ff2cb8cf640 1 -- start start 2026-02-20T02:24:56.476 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.410+0000 7ff2cb8cf640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c4109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:56.476 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.410+0000 7ff2cb8cf640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c410a250 con 0x7ff2c4109880 2026-02-20T02:24:56.477 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.410+0000 7ff2c9644640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c4109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:56.477 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.410+0000 7ff2c9644640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c4109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36874/0 (socket says 10.20.193.98:36874) 2026-02-20T02:24:56.477 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.410+0000 7ff2c9644640 1 -- 10.20.193.98:0/1926950506 learned_addr learned my addr 10.20.193.98:0/1926950506 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:56.477 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2c9644640 1 -- 10.20.193.98:0/1926950506 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c410aa80 con 0x7ff2c4109880 2026-02-20T02:24:56.477 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2c9644640 1 --2- 10.20.193.98:0/1926950506 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c4109c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009920 tx=0x7ff2b402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffbd7fbde563b8e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:56.477 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2b3fff640 1 -- 10.20.193.98:0/1926950506 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2b403c070 con 0x7ff2c4109880 2026-02-20T02:24:56.477 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2b3fff640 1 -- 10.20.193.98:0/1926950506 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b402f9b0 con 0x7ff2c4109880 2026-02-20T02:24:56.478 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2b3fff640 1 -- 10.20.193.98:0/1926950506 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2b402fcd0 con 0x7ff2c4109880 2026-02-20T02:24:56.478 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/1926950506 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 msgr2=0x7ff2c4109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:56.478 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2cb8cf640 1 --2- 10.20.193.98:0/1926950506 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c4109c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009920 tx=0x7ff2b402ef20 comp rx=0 tx=0).stop 2026-02-20T02:24:56.478 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/1926950506 shutdown_connections 2026-02-20T02:24:56.478 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2cb8cf640 1 --2- 10.20.193.98:0/1926950506 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c4109c80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.478 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/1926950506 >> 10.20.193.98:0/1926950506 conn(0x7ff2c407ce10 msgr2=0x7ff2c407d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:56.478 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/1926950506 shutdown_connections 2026-02-20T02:24:56.478 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.411+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/1926950506 wait complete. 2026-02-20T02:24:56.479 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2cb8cf640 1 Processor -- start 2026-02-20T02:24:56.479 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2cb8cf640 1 -- start start 2026-02-20T02:24:56.479 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2cb8cf640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:56.479 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2cb8cf640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c410afb0 con 0x7ff2c4109880 2026-02-20T02:24:56.479 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2c9644640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:56.479 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2c9644640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36888/0 (socket says 10.20.193.98:36888) 2026-02-20T02:24:56.479 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2c9644640 1 -- 10.20.193.98:0/920844574 learned_addr learned my addr 10.20.193.98:0/920844574 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:56.479 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2c9644640 1 -- 10.20.193.98:0/920844574 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c419f420 con 0x7ff2c4109880 2026-02-20T02:24:56.480 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2c9644640 1 --2- 10.20.193.98:0/920844574 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c419eee0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009a50 tx=0x7ff2b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:56.480 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2b27fc640 1 -- 10.20.193.98:0/920844574 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2b4043410 con 0x7ff2c4109880 2026-02-20T02:24:56.480 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2b27fc640 1 -- 10.20.193.98:0/920844574 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b4048070 con 0x7ff2c4109880 2026-02-20T02:24:56.480 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c419f6b0 con 0x7ff2c4109880 2026-02-20T02:24:56.480 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2b27fc640 1 -- 10.20.193.98:0/920844574 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2b4043760 con 0x7ff2c4109880 2026-02-20T02:24:56.480 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c41a23a0 con 0x7ff2c4109880 2026-02-20T02:24:56.480 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2b27fc640 1 -- 10.20.193.98:0/920844574 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff2b4043900 con 0x7ff2c4109880 2026-02-20T02:24:56.480 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.412+0000 7ff2b27fc640 1 -- 10.20.193.98:0/920844574 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff2b404da40 con 0x7ff2c4109880 2026-02-20T02:24:56.481 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.413+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c410b670 con 0x7ff2c4109880 2026-02-20T02:24:56.481 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.414+0000 7ff2b27fc640 1 -- 10.20.193.98:0/920844574 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7ff2b4040050 con 0x7ff2c4109880 2026-02-20T02:24:56.481 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.443+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ff2c41981a0 con 0x7ff2c4109880 2026-02-20T02:24:56.481 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.445+0000 7ff2b27fc640 1 -- 10.20.193.98:0/920844574 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+374 (secure 0 0 0) 0x7ff2b404d460 con 0x7ff2c4109880 2026-02-20T02:24:56.481 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.445+0000 7ff2b27fc640 1 -- 10.20.193.98:0/920844574 <== mon.0 v2:10.20.193.98:3300/0 8 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7ff2b402f9b0 con 0x7ff2c4109880 2026-02-20T02:24:56.481 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.446+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 msgr2=0x7ff2c419eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:56.481 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.446+0000 7ff2cb8cf640 1 --2- 10.20.193.98:0/920844574 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c419eee0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009a50 tx=0x7ff2b40047c0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.482 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.446+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 shutdown_connections 2026-02-20T02:24:56.482 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.446+0000 7ff2cb8cf640 1 --2- 10.20.193.98:0/920844574 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2c4109880 0x7ff2c419eee0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.482 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.446+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 >> 10.20.193.98:0/920844574 conn(0x7ff2c407ce10 msgr2=0x7ff2c41931d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:56.482 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.446+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 shutdown_connections 2026-02-20T02:24:56.482 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.446+0000 7ff2cb8cf640 1 -- 10.20.193.98:0/920844574 wait complete. 2026-02-20T02:24:56.482 INFO:teuthology.orchestra.run.trial098.stdout:Generating new minimal ceph.conf... 2026-02-20T02:24:56.627 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.560+0000 7f4e6d2c0640 1 Processor -- start 2026-02-20T02:24:56.627 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.560+0000 7f4e6d2c0640 1 -- start start 2026-02-20T02:24:56.627 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.560+0000 7f4e6d2c0640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e68109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:56.627 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e6d2c0640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6810a250 con 0x7f4e68109880 2026-02-20T02:24:56.628 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e66ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e68109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:56.628 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e66ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e68109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36904/0 (socket says 10.20.193.98:36904) 2026-02-20T02:24:56.628 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e66ffd640 1 -- 10.20.193.98:0/2238073007 learned_addr learned my addr 10.20.193.98:0/2238073007 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:56.628 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e66ffd640 1 -- 10.20.193.98:0/2238073007 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6810aa80 con 0x7f4e68109880 2026-02-20T02:24:56.628 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e66ffd640 1 --2- 10.20.193.98:0/2238073007 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e68109c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009920 tx=0x7f4e5c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad998fa5c323b5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:56.629 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e65ffb640 1 -- 10.20.193.98:0/2238073007 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4e5c03c070 con 0x7f4e68109880 2026-02-20T02:24:56.629 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e65ffb640 1 -- 10.20.193.98:0/2238073007 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f4e5c02fe00 con 0x7f4e68109880 2026-02-20T02:24:56.629 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.561+0000 7f4e65ffb640 1 -- 10.20.193.98:0/2238073007 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4e5c035340 con 0x7f4e68109880 2026-02-20T02:24:56.629 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/2238073007 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 msgr2=0x7f4e68109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:56.629 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 --2- 10.20.193.98:0/2238073007 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e68109c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009920 tx=0x7f4e5c02ef20 comp rx=0 tx=0).stop 2026-02-20T02:24:56.629 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/2238073007 shutdown_connections 2026-02-20T02:24:56.630 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 --2- 10.20.193.98:0/2238073007 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e68109c80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.630 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/2238073007 >> 10.20.193.98:0/2238073007 conn(0x7f4e6807cf00 msgr2=0x7f4e6807d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:56.630 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/2238073007 shutdown_connections 2026-02-20T02:24:56.630 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/2238073007 wait complete. 2026-02-20T02:24:56.630 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 Processor -- start 2026-02-20T02:24:56.630 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 -- start start 2026-02-20T02:24:56.631 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e6819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:56.631 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e6d2c0640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6810dcb0 con 0x7f4e68109880 2026-02-20T02:24:56.631 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e66ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e6819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:56.631 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e66ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e6819f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36910/0 (socket says 10.20.193.98:36910) 2026-02-20T02:24:56.631 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.562+0000 7f4e66ffd640 1 -- 10.20.193.98:0/4282487482 learned_addr learned my addr 10.20.193.98:0/4282487482 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:56.631 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e66ffd640 1 -- 10.20.193.98:0/4282487482 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6819fce0 con 0x7f4e68109880 2026-02-20T02:24:56.631 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e66ffd640 1 --2- 10.20.193.98:0/4282487482 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e6819f7a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c037b20 tx=0x7f4e5c0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:56.632 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e47fff640 1 -- 10.20.193.98:0/4282487482 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4e5c035c10 con 0x7f4e68109880 2026-02-20T02:24:56.632 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e47fff640 1 -- 10.20.193.98:0/4282487482 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f4e5c035db0 con 0x7f4e68109880 2026-02-20T02:24:56.632 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6819ff70 con 0x7f4e68109880 2026-02-20T02:24:56.632 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e47fff640 1 -- 10.20.193.98:0/4282487482 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4e5c0413a0 con 0x7f4e68109880 2026-02-20T02:24:56.632 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e681a2c60 con 0x7f4e68109880 2026-02-20T02:24:56.632 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e47fff640 1 -- 10.20.193.98:0/4282487482 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4e5c041650 con 0x7f4e68109880 2026-02-20T02:24:56.633 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e47fff640 1 -- 10.20.193.98:0/4282487482 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4e5c04b920 con 0x7f4e68109880 2026-02-20T02:24:56.633 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.563+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e68109d00 con 0x7f4e68109880 2026-02-20T02:24:56.633 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.564+0000 7f4e47fff640 1 -- 10.20.193.98:0/4282487482 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f4e5c04b3f0 con 0x7f4e68109880 2026-02-20T02:24:56.633 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.592+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f4e681a2ed0 con 0x7f4e68109880 2026-02-20T02:24:56.633 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.592+0000 7f4e47fff640 1 -- 10.20.193.98:0/4282487482 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f4e5c04bb70 con 0x7f4e68109880 2026-02-20T02:24:56.633 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.593+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 msgr2=0x7f4e6819f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:56.634 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.593+0000 7f4e6d2c0640 1 --2- 10.20.193.98:0/4282487482 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e6819f7a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c037b20 tx=0x7f4e5c0358c0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.634 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.593+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 shutdown_connections 2026-02-20T02:24:56.634 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.593+0000 7f4e6d2c0640 1 --2- 10.20.193.98:0/4282487482 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4e68109880 0x7f4e6819f7a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:56.634 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.593+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 >> 10.20.193.98:0/4282487482 conn(0x7f4e6807cf00 msgr2=0x7f4e681070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:56.634 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.593+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 shutdown_connections 2026-02-20T02:24:56.635 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:56.593+0000 7f4e6d2c0640 1 -- 10.20.193.98:0/4282487482 wait complete. 2026-02-20T02:24:56.635 INFO:teuthology.orchestra.run.trial098.stdout:Restarting the monitor... 2026-02-20T02:24:56.954 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 systemd[1]: Stopping Ceph mon.trial098 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:24:56.954 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098[38483]: 2026-02-20T02:24:56.709+0000 7fda44990640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:24:56.954 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098[38483]: 2026-02-20T02:24:56.709+0000 7fda44990640 -1 mon.trial098@0(leader) e1 *** Got Signal Terminated *** 2026-02-20T02:24:57.141 INFO:teuthology.orchestra.run.trial098.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-20T02:24:57.214 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 podman[38772]: 2026-02-20 02:24:56.95322784 +0000 UTC m=+0.256044940 container died 7f7d2ec03073f81afee7dd25b8cf5eb0c31034409be90e0da9558a1e0bd87043 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T02:24:57.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 podman[38772]: 2026-02-20 02:24:56.960660079 +0000 UTC m=+0.263477179 container remove 7f7d2ec03073f81afee7dd25b8cf5eb0c31034409be90e0da9558a1e0bd87043 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T02:24:57.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:56 trial098 bash[38772]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098 2026-02-20T02:24:57.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 systemd[1]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial098.service: Deactivated successfully. 2026-02-20T02:24:57.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 systemd[1]: Stopped Ceph mon.trial098 for 5138774d-0e03-11f1-8edf-d404e6e7d460. 2026-02-20T02:24:57.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 systemd[1]: Starting Ceph mon.trial098 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:24:57.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 podman[38893]: 2026-02-20 02:24:57.109776714 +0000 UTC m=+0.014952301 container create befd98d6a87d6c4b0ae681b14a55507cf02d50d42e33451f2b06a7b89e045a4d (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T02:24:57.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 podman[38893]: 2026-02-20 02:24:57.134093063 +0000 UTC m=+0.039268661 container init befd98d6a87d6c4b0ae681b14a55507cf02d50d42e33451f2b06a7b89e045a4d (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098, io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T02:24:57.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 podman[38893]: 2026-02-20 02:24:57.136586967 +0000 UTC m=+0.041762544 container start befd98d6a87d6c4b0ae681b14a55507cf02d50d42e33451f2b06a7b89e045a4d (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 bash[38893]: befd98d6a87d6c4b0ae681b14a55507cf02d50d42e33451f2b06a7b89e045a4d 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 podman[38893]: 2026-02-20 02:24:57.104039618 +0000 UTC m=+0.009215205 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 systemd[1]: Started Ceph mon.trial098 for 5138774d-0e03-11f1-8edf-d404e6e7d460. 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: set uid:gid to 167:167 (ceph:ceph) 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable), process ceph-mon, pid 2 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: pidfile_write: ignore empty --pid-file 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: load: jerasure load: lrc 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: RocksDB version: 7.9.2 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Git sha 0 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Compile date 2026-02-18 01:04:15 2026-02-20T02:24:57.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: DB SUMMARY 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: DB Session ID: NMYHF3SDI7EGCFPS54ON 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: CURRENT file: CURRENT 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: IDENTITY file: IDENTITY 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: SST files in /var/lib/ceph/mon/ceph-trial098/store.db dir, Total Num: 1, files: 000008.sst 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-trial098/store.db: 000009.log size: 82937 ; 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.error_if_exists: 0 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.create_if_missing: 0 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.paranoid_checks: 1 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-20T02:24:57.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.env: 0x55ecaf23cdc0 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.fs: PosixFileSystem 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.info_log: 0x55ecb1289a20 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_file_opening_threads: 16 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.statistics: (nil) 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.use_fsync: 0 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_log_file_size: 0 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.keep_log_file_num: 1000 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.recycle_log_file_num: 0 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.allow_fallocate: 1 2026-02-20T02:24:57.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.allow_mmap_reads: 0 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.allow_mmap_writes: 0 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.use_direct_reads: 0 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.create_missing_column_families: 0 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.db_log_dir: 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.wal_dir: 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-20T02:24:57.219 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.advise_random_on_open: 1 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.db_write_buffer_size: 0 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.write_buffer_manager: 0x55ecb128d900 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.rate_limiter: (nil) 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.wal_recovery_mode: 2 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.enable_thread_tracking: 0 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.enable_pipelined_write: 0 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.unordered_write: 0 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-20T02:24:57.220 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.row_cache: None 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.wal_filter: None 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.allow_ingest_behind: 0 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.two_write_queues: 0 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.manual_wal_flush: 0 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.wal_compression: 0 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.atomic_flush: 0 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-20T02:24:57.221 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.log_readahead_size: 0 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.best_efforts_recovery: 0 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.allow_data_in_errors: 0 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.db_host_id: __hostname__ 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_background_jobs: 2 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_background_compactions: -1 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_subcompactions: 1 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-20T02:24:57.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_total_wal_size: 0 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_open_files: -1 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bytes_per_sync: 0 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_readahead_size: 0 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_background_flushes: -1 2026-02-20T02:24:57.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Compression algorithms supported: 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: kZSTD supported: 0 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: kXpressCompression supported: 0 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: kBZip2Compression supported: 0 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: kLZ4Compression supported: 1 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: kZlibCompression supported: 1 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: kLZ4HCCompression supported: 1 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: kSnappyCompression supported: 1 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-trial098/store.db/MANIFEST-000010 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-20T02:24:57.224 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.merge_operator: 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_filter: None 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_filter_factory: None 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.sst_partitioner_factory: None 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ecb1288700) 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout: cache_index_and_filter_blocks: 1 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout: pin_top_level_index_and_filter: 1 2026-02-20T02:24:57.225 INFO:journalctl@ceph.mon.trial098.trial098.stdout: index_type: 0 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: data_block_index_type: 0 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: index_shortening: 1 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: checksum: 4 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: no_block_cache: 0 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: block_cache: 0x55ecb12ad350 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: block_cache_name: BinnedLRUCache 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: block_cache_options: 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: capacity : 536870912 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: num_shard_bits : 4 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: strict_capacity_limit : 0 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: high_pri_pool_ratio: 0.000 2026-02-20T02:24:57.226 INFO:journalctl@ceph.mon.trial098.trial098.stdout: block_cache_compressed: (nil) 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: persistent_cache: (nil) 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: block_size: 4096 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: block_size_deviation: 10 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: block_restart_interval: 16 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: index_block_restart_interval: 1 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: metadata_block_size: 4096 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: partition_filters: 0 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: use_delta_encoding: 1 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: filter_policy: bloomfilter 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: whole_key_filtering: 1 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: verify_compression: 0 2026-02-20T02:24:57.227 INFO:journalctl@ceph.mon.trial098.trial098.stdout: read_amp_bytes_per_bit: 0 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout: format_version: 5 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout: enable_index_compression: 1 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout: block_align: 0 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout: max_auto_readahead_size: 262144 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout: prepopulate_block_cache: 0 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout: initial_auto_readahead_size: 8192 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout: num_file_reads_for_auto_readahead: 2 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.write_buffer_size: 33554432 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_write_buffer_number: 2 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression: NoCompression 2026-02-20T02:24:57.228 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression: Disabled 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.prefix_extractor: nullptr 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.num_levels: 7 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-20T02:24:57.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.level: 32767 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.strategy: 0 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.enabled: false 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-20T02:24:57.230 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.target_file_size_base: 67108864 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-20T02:24:57.231 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.arena_block_size: 1048576 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.disable_auto_compactions: 0 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-20T02:24:57.232 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.inplace_update_support: 0 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.bloom_locality: 0 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.max_successive_merges: 0 2026-02-20T02:24:57.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.paranoid_file_checks: 0 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.force_consistency_checks: 1 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.report_bg_io_stats: 0 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.ttl: 2592000 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.enable_blob_files: false 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.min_blob_size: 0 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.blob_file_size: 268435456 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-20T02:24:57.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.blob_file_starting_level: 0 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-trial098/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f01131e5-af2d-4d3d-bc4b-7061905cf277 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771554297155636, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771554297156393, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 79336, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 257, "table_properties": {"data_size": 77513, "index_size": 208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11481, "raw_average_key_size": 50, "raw_value_size": 71160, "raw_average_value_size": 312, "num_data_blocks": 9, "num_entries": 228, "num_filter_entries": 228, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771554297, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f01131e5-af2d-4d3d-bc4b-7061905cf277", "db_session_id": "NMYHF3SDI7EGCFPS54ON", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771554297156459, "job": 1, "event": "recovery_finished"} 2026-02-20T02:24:57.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-trial098/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ecb12aee00 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: DB pointer 0x55ecb13bc000 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout: ** DB Stats ** 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-20T02:24:57.236 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: ** Compaction Stats [default] ** 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: L0 2/0 79.37 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Sum 2/0 79.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: ** Compaction Stats [default] ** 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-20T02:24:57.237 INFO:journalctl@ceph.mon.trial098.trial098.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Cumulative compaction: 0.00 GB write, 27.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Interval compaction: 0.00 GB write, 27.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-20T02:24:57.238 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Block cache BinnedLRUCache@0x55ecb12ad350#2 capacity: 512.00 MB usage: 1.16 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.39 KB,7.45058e-05%) Misc(1,0.00 KB,0%) 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout: 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: starting mon.trial098 rank 0 at public addrs [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] at bind addrs [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] mon_data /var/lib/ceph/mon/ceph-trial098 fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098@-1(???) e1 preinit fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098@-1(???).mds e1 new map 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098@-1(???).mds e1 print_map 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout: e1 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout: btime 2026-02-20T02:24:56:142211+0000 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-20T02:24:57.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout: legacy client fscid: -1 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout: 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout: No filesystems configured 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mon.trial098 is new leader, mons trial098 in quorum (ranks 0) 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: monmap epoch 1 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: last_changed 2026-02-20T02:24:55.178003+0000 2026-02-20T02:24:57.240 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: created 2026-02-20T02:24:55.178003+0000 2026-02-20T02:24:57.241 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: min_mon_release 19 (squid) 2026-02-20T02:24:57.241 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: election_strategy: 1 2026-02-20T02:24:57.241 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: 0: [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] mon.trial098 2026-02-20T02:24:57.241 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: fsmap 2026-02-20T02:24:57.241 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: osdmap e1: 0 total, 0 up, 0 in 2026-02-20T02:24:57.241 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:57 trial098 ceph-mon[38923]: mgrmap e1: no daemons active 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.241+0000 7fca7f3e5640 1 Processor -- start 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.241+0000 7fca7f3e5640 1 -- start start 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.241+0000 7fca7f3e5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca78107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.241+0000 7fca7f3e5640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca78107fd0 con 0x7fca78107600 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.241+0000 7fca7d15a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca78107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.241+0000 7fca7d15a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca78107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36912/0 (socket says 10.20.193.98:36912) 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.241+0000 7fca7d15a640 1 -- 10.20.193.98:0/3492950431 learned_addr learned my addr 10.20.193.98:0/3492950431 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.241+0000 7fca7d15a640 1 -- 10.20.193.98:0/3492950431 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca78108800 con 0x7fca78107600 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.242+0000 7fca7d15a640 1 --2- 10.20.193.98:0/3492950431 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca78107a00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fca68009920 tx=0x7fca6802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c34f3fd40672a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.242+0000 7fca67fff640 1 -- 10.20.193.98:0/3492950431 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fca6803c070 con 0x7fca78107600 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.242+0000 7fca67fff640 1 -- 10.20.193.98:0/3492950431 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fca6802fe00 con 0x7fca78107600 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.242+0000 7fca67fff640 1 -- 10.20.193.98:0/3492950431 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fca68035340 con 0x7fca78107600 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 -- 10.20.193.98:0/3492950431 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 msgr2=0x7fca78107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 --2- 10.20.193.98:0/3492950431 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca78107a00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fca68009920 tx=0x7fca6802ef20 comp rx=0 tx=0).stop 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 -- 10.20.193.98:0/3492950431 shutdown_connections 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 --2- 10.20.193.98:0/3492950431 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca78107a00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:57.297 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 -- 10.20.193.98:0/3492950431 >> 10.20.193.98:0/3492950431 conn(0x7fca78102dd0 msgr2=0x7fca781051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 -- 10.20.193.98:0/3492950431 shutdown_connections 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 -- 10.20.193.98:0/3492950431 wait complete. 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 Processor -- start 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 -- start start 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca7819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7f3e5640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca7810ba30 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7d15a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca7819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7d15a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca7819f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36926/0 (socket says 10.20.193.98:36926) 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.243+0000 7fca7d15a640 1 -- 10.20.193.98:0/1106762896 learned_addr learned my addr 10.20.193.98:0/1106762896 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca7d15a640 1 -- 10.20.193.98:0/1106762896 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7819fca0 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca7d15a640 1 --2- 10.20.193.98:0/1106762896 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca7819f760 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fca68037b20 tx=0x7fca680358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca667fc640 1 -- 10.20.193.98:0/1106762896 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fca68035c10 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca667fc640 1 -- 10.20.193.98:0/1106762896 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fca68035db0 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7819ff30 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca667fc640 1 -- 10.20.193.98:0/1106762896 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fca680413a0 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca781a2c20 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca667fc640 1 -- 10.20.193.98:0/1106762896 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fca68041650 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca667fc640 1 -- 10.20.193.98:0/1106762896 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fca6804b920 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.244+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca78107a80 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.246+0000 7fca667fc640 1 -- 10.20.193.98:0/1106762896 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fca6804b3f0 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.273+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fca781a2e90 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.275+0000 7fca667fc640 1 -- 10.20.193.98:0/1106762896 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 125+0+0 (secure 0 0 0) 0x7fca6804bb20 con 0x7fca78107600 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.275+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 msgr2=0x7fca7819f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.275+0000 7fca7f3e5640 1 --2- 10.20.193.98:0/1106762896 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca7819f760 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fca68037b20 tx=0x7fca680358c0 comp rx=0 tx=0).stop 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.275+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 shutdown_connections 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.275+0000 7fca7f3e5640 1 --2- 10.20.193.98:0/1106762896 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fca78107600 0x7fca7819f760 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.275+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 >> 10.20.193.98:0/1106762896 conn(0x7fca78102dd0 msgr2=0x7fca78103940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.275+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 shutdown_connections 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.275+0000 7fca7f3e5640 1 -- 10.20.193.98:0/1106762896 wait complete. 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:Creating mgr... 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-20T02:24:57.298 INFO:teuthology.orchestra.run.trial098.stdout:Verifying port 0.0.0.0:8443 ... 2026-02-20T02:24:57.429 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mgr.trial098.hiicxh 2026-02-20T02:24:57.430 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mgr.trial098.hiicxh.service: Unit ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mgr.trial098.hiicxh.service not loaded. 2026-02-20T02:24:57.535 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460.target.wants/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mgr.trial098.hiicxh.service → /etc/systemd/system/ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@.service. 2026-02-20T02:24:57.674 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T02:24:57.674 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout disabled 2026-02-20T02:24:57.679 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T02:24:57.679 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout inactive 2026-02-20T02:24:57.679 INFO:teuthology.orchestra.run.trial098.stdout:firewalld.service is not enabled 2026-02-20T02:24:57.679 INFO:teuthology.orchestra.run.trial098.stdout:Not possible to enable service . firewalld.service is not available 2026-02-20T02:24:57.686 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T02:24:57.687 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout disabled 2026-02-20T02:24:57.692 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T02:24:57.692 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout inactive 2026-02-20T02:24:57.692 INFO:teuthology.orchestra.run.trial098.stdout:firewalld.service is not enabled 2026-02-20T02:24:57.692 INFO:teuthology.orchestra.run.trial098.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2026-02-20T02:24:57.692 INFO:teuthology.orchestra.run.trial098.stdout:Waiting for mgr to start... 2026-02-20T02:24:57.692 INFO:teuthology.orchestra.run.trial098.stdout:Waiting for mgr... 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout { 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "fsid": "5138774d-0e03-11f1-8edf-d404e6e7d460", 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 0 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "trial098" 2026-02-20T02:24:57.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T02:24:57.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T02:24:56:142211+0000", 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "restful" 2026-02-20T02:24:57.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T02:24:56.142623+0000", 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout } 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.802+0000 7f812a6da640 1 Processor -- start 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.802+0000 7f812a6da640 1 -- start start 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.802+0000 7f812a6da640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f8124109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.802+0000 7f812a6da640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f812410a250 con 0x7f8124109880 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.803+0000 7f8123fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f8124109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.803+0000 7f8123fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f8124109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36964/0 (socket says 10.20.193.98:36964) 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.803+0000 7f8123fff640 1 -- 10.20.193.98:0/2645325769 learned_addr learned my addr 10.20.193.98:0/2645325769 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.803+0000 7f8123fff640 1 -- 10.20.193.98:0/2645325769 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812410aa80 con 0x7f8124109880 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.803+0000 7f8123fff640 1 --2- 10.20.193.98:0/2645325769 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f8124109c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8110009920 tx=0x7f811002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8077d291f365a1e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.803+0000 7f8122ffd640 1 -- 10.20.193.98:0/2645325769 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f811003c070 con 0x7f8124109880 2026-02-20T02:24:57.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f8122ffd640 1 -- 10.20.193.98:0/2645325769 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f811002fe00 con 0x7f8124109880 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f8122ffd640 1 -- 10.20.193.98:0/2645325769 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8110035340 con 0x7f8124109880 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 -- 10.20.193.98:0/2645325769 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 msgr2=0x7f8124109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 --2- 10.20.193.98:0/2645325769 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f8124109c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8110009920 tx=0x7f811002ef20 comp rx=0 tx=0).stop 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 -- 10.20.193.98:0/2645325769 shutdown_connections 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 --2- 10.20.193.98:0/2645325769 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f8124109c80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 -- 10.20.193.98:0/2645325769 >> 10.20.193.98:0/2645325769 conn(0x7f812407cf00 msgr2=0x7f812407d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 -- 10.20.193.98:0/2645325769 shutdown_connections 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 -- 10.20.193.98:0/2645325769 wait complete. 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 Processor -- start 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 -- start start 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f812419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f812a6da640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f812410dcb0 con 0x7f8124109880 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f8123fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f812419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f8123fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f812419f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:36980/0 (socket says 10.20.193.98:36980) 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f8123fff640 1 -- 10.20.193.98:0/3140559782 learned_addr learned my addr 10.20.193.98:0/3140559782 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.804+0000 7f8123fff640 1 -- 10.20.193.98:0/3140559782 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812419fce0 con 0x7f8124109880 2026-02-20T02:24:57.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f8123fff640 1 --2- 10.20.193.98:0/3140559782 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f812419f7a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8110002410 tx=0x7f8110037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f81217fa640 1 -- 10.20.193.98:0/3140559782 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8110035970 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f81217fa640 1 -- 10.20.193.98:0/3140559782 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f81100423f0 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f81217fa640 1 -- 10.20.193.98:0/3140559782 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f81100413a0 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812419ff70 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81241a2c60 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f81217fa640 1 -- 10.20.193.98:0/3140559782 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8110041620 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f81217fa640 1 -- 10.20.193.98:0/3140559782 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f811004b890 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.805+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8124109d00 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.806+0000 7f81217fa640 1 -- 10.20.193.98:0/3140559782 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f811004b3f0 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.834+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f81241a2ed0 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.835+0000 7f81217fa640 1 -- 10.20.193.98:0/3140559782 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1298 (secure 0 0 0) 0x7f81100425a0 con 0x7f8124109880 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.835+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 msgr2=0x7f812419f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.835+0000 7f812a6da640 1 --2- 10.20.193.98:0/3140559782 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f812419f7a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8110002410 tx=0x7f8110037a50 comp rx=0 tx=0).stop 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.835+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 shutdown_connections 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.835+0000 7f812a6da640 1 --2- 10.20.193.98:0/3140559782 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8124109880 0x7f812419f7a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.835+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 >> 10.20.193.98:0/3140559782 conn(0x7f812407cf00 msgr2=0x7f81241070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.835+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 shutdown_connections 2026-02-20T02:24:57.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:57.835+0000 7f812a6da640 1 -- 10.20.193.98:0/3140559782 wait complete. 2026-02-20T02:24:57.866 INFO:teuthology.orchestra.run.trial098.stdout:mgr not available, waiting (1/15)... 2026-02-20T02:24:58.310 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:58 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1106762896' entity='client.admin' 2026-02-20T02:24:58.310 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:24:58 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3140559782' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T02:25:00.018 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout { 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "fsid": "5138774d-0e03-11f1-8edf-d404e6e7d460", 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 0 2026-02-20T02:25:00.019 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "trial098" 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:25:00.020 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T02:25:00.021 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T02:24:56:142211+0000", 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:00.022 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "restful" 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:00.023 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T02:24:56.142623+0000", 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout } 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.956+0000 7f0eb33b1640 1 Processor -- start 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.956+0000 7f0eb33b1640 1 -- start start 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.956+0000 7f0eb33b1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.956+0000 7f0eb33b1640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac10a250 con 0x7f0eac109880 2026-02-20T02:25:00.024 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.957+0000 7f0eb1126640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.957+0000 7f0eb1126640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:43946/0 (socket says 10.20.193.98:43946) 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.957+0000 7f0eb1126640 1 -- 10.20.193.98:0/3983110454 learned_addr learned my addr 10.20.193.98:0/3983110454 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.957+0000 7f0eb1126640 1 -- 10.20.193.98:0/3983110454 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac10aa80 con 0x7f0eac109880 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.957+0000 7f0eb1126640 1 --2- 10.20.193.98:0/3983110454 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac109c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009920 tx=0x7f0e9c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c292ca935d5816 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.957+0000 7f0e9bfff640 1 -- 10.20.193.98:0/3983110454 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0e9c03c070 con 0x7f0eac109880 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.957+0000 7f0e9bfff640 1 -- 10.20.193.98:0/3983110454 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f0e9c02fe00 con 0x7f0eac109880 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.957+0000 7f0e9bfff640 1 -- 10.20.193.98:0/3983110454 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0e9c035340 con 0x7f0eac109880 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 -- 10.20.193.98:0/3983110454 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 msgr2=0x7f0eac109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 --2- 10.20.193.98:0/3983110454 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac109c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009920 tx=0x7f0e9c02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:00.025 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 -- 10.20.193.98:0/3983110454 shutdown_connections 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 --2- 10.20.193.98:0/3983110454 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac109c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 -- 10.20.193.98:0/3983110454 >> 10.20.193.98:0/3983110454 conn(0x7f0eac07cf00 msgr2=0x7f0eac07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 -- 10.20.193.98:0/3983110454 shutdown_connections 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 -- 10.20.193.98:0/3983110454 wait complete. 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 Processor -- start 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 -- start start 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb33b1640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac10dcb0 con 0x7f0eac109880 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb1126640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:00.026 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb1126640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac19f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:43960/0 (socket says 10.20.193.98:43960) 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb1126640 1 -- 10.20.193.98:0/1286332491 learned_addr learned my addr 10.20.193.98:0/1286332491 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb1126640 1 -- 10.20.193.98:0/1286332491 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac19fce0 con 0x7f0eac109880 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0eb1126640 1 --2- 10.20.193.98:0/1286332491 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac19f7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c002410 tx=0x7f0e9c037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.958+0000 7f0e9a7fc640 1 -- 10.20.193.98:0/1286332491 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0e9c035970 con 0x7f0eac109880 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.959+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eac19ff70 con 0x7f0eac109880 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.959+0000 7f0e9a7fc640 1 -- 10.20.193.98:0/1286332491 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f0e9c0423f0 con 0x7f0eac109880 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.959+0000 7f0e9a7fc640 1 -- 10.20.193.98:0/1286332491 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0e9c0413a0 con 0x7f0eac109880 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.959+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eac1a2c60 con 0x7f0eac109880 2026-02-20T02:25:00.027 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.959+0000 7f0e9a7fc640 1 -- 10.20.193.98:0/1286332491 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0e9c041620 con 0x7f0eac109880 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.959+0000 7f0e9a7fc640 1 -- 10.20.193.98:0/1286332491 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0e9c04b890 con 0x7f0eac109880 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.959+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eac109d00 con 0x7f0eac109880 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.960+0000 7f0e9a7fc640 1 -- 10.20.193.98:0/1286332491 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f0e9c04b3f0 con 0x7f0eac109880 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0eac1a2ed0 con 0x7f0eac109880 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0e9a7fc640 1 -- 10.20.193.98:0/1286332491 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1298 (secure 0 0 0) 0x7f0e9c0425a0 con 0x7f0eac109880 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 msgr2=0x7f0eac19f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0eb33b1640 1 --2- 10.20.193.98:0/1286332491 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac19f7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c002410 tx=0x7f0e9c037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 shutdown_connections 2026-02-20T02:25:00.028 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0eb33b1640 1 --2- 10.20.193.98:0/1286332491 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0eac109880 0x7f0eac19f7a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:00.029 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 >> 10.20.193.98:0/1286332491 conn(0x7f0eac07cf00 msgr2=0x7f0eac1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:00.029 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 shutdown_connections 2026-02-20T02:25:00.029 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:24:59.989+0000 7f0eb33b1640 1 -- 10.20.193.98:0/1286332491 wait complete. 2026-02-20T02:25:00.029 INFO:teuthology.orchestra.run.trial098.stdout:mgr not available, waiting (2/15)... 2026-02-20T02:25:00.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:00 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1286332491' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T02:25:01.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: Activating manager daemon trial098.hiicxh 2026-02-20T02:25:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: mgrmap e2: trial098.hiicxh(active, starting, since 0.00276179s) 2026-02-20T02:25:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T02:25:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T02:25:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T02:25:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:25:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr metadata", "who": "trial098.hiicxh", "id": "trial098.hiicxh"}]: dispatch 2026-02-20T02:25:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: Manager daemon trial098.hiicxh is now available 2026-02-20T02:25:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial098.hiicxh/mirror_snapshot_schedule"}]: dispatch 2026-02-20T02:25:01.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:01.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial098.hiicxh/trash_purge_schedule"}]: dispatch 2026-02-20T02:25:01.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:01.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:01 trial098 ceph-mon[38923]: from='mgr.14100 10.20.193.98:0/1800772994' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout { 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "fsid": "5138774d-0e03-11f1-8edf-d404e6e7d460", 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 0 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "trial098" 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T02:25:02.255 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T02:24:56:142211+0000", 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "restful" 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ], 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T02:24:56.142623+0000", 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout }, 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout } 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.104+0000 7f13fb4e7640 1 Processor -- start 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.104+0000 7f13fb4e7640 1 -- start start 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.104+0000 7f13fb4e7640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f4109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.104+0000 7f13fb4e7640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f13f410a250 con 0x7f13f4109880 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.104+0000 7f13f925c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f4109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.104+0000 7f13f925c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f4109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44038/0 (socket says 10.20.193.98:44038) 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.104+0000 7f13f925c640 1 -- 10.20.193.98:0/3440027841 learned_addr learned my addr 10.20.193.98:0/3440027841 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.105+0000 7f13f925c640 1 -- 10.20.193.98:0/3440027841 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f410aa80 con 0x7f13f4109880 2026-02-20T02:25:02.256 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.105+0000 7f13f925c640 1 --2- 10.20.193.98:0/3440027841 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f4109c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009920 tx=0x7f13e402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48855f4bb6527f4f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.105+0000 7f13e3fff640 1 -- 10.20.193.98:0/3440027841 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f13e403c070 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.105+0000 7f13e3fff640 1 -- 10.20.193.98:0/3440027841 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f13e402fe00 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.105+0000 7f13e3fff640 1 -- 10.20.193.98:0/3440027841 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f13e4035340 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 -- 10.20.193.98:0/3440027841 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 msgr2=0x7f13f4109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 --2- 10.20.193.98:0/3440027841 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f4109c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009920 tx=0x7f13e402ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 -- 10.20.193.98:0/3440027841 shutdown_connections 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 --2- 10.20.193.98:0/3440027841 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f4109c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 -- 10.20.193.98:0/3440027841 >> 10.20.193.98:0/3440027841 conn(0x7f13f407cf00 msgr2=0x7f13f407d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 -- 10.20.193.98:0/3440027841 shutdown_connections 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 -- 10.20.193.98:0/3440027841 wait complete. 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 Processor -- start 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 -- start start 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f13f410dcb0 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13f925c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13f925c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f419f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44040/0 (socket says 10.20.193.98:44040) 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13f925c640 1 -- 10.20.193.98:0/1818985204 learned_addr learned my addr 10.20.193.98:0/1818985204 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13f925c640 1 -- 10.20.193.98:0/1818985204 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f419fce0 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13f925c640 1 --2- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f419f7a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13e4037b20 tx=0x7f13e40358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13e27fc640 1 -- 10.20.193.98:0/1818985204 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f13e4035c10 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f419ff70 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13e27fc640 1 -- 10.20.193.98:0/1818985204 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f13e4035db0 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.106+0000 7f13e27fc640 1 -- 10.20.193.98:0/1818985204 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f13e40413a0 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.107+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f41a2c60 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.107+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f4109d00 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.107+0000 7f13e27fc640 1 -- 10.20.193.98:0/1818985204 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 3) ==== 50144+0+0 (secure 0 0 0) 0x7f13e40423f0 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.107+0000 7f13e27fc640 1 --2- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f13d003da80 0x7f13d003ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.107+0000 7f13e27fc640 1 -- 10.20.193.98:0/1818985204 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f13e4076110 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.107+0000 7f13f8a5b640 1 --2- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f13d003da80 0x7f13d003ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.108+0000 7f13f8a5b640 1 --2- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f13d003da80 0x7f13d003ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f13e80099c0 tx=0x7f13e8006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.110+0000 7f13e27fc640 1 -- 10.20.193.98:0/1818985204 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f13e4041650 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.224+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f13f41a3350 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.224+0000 7f13e27fc640 1 -- 10.20.193.98:0/1818985204 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1297 (secure 0 0 0) 0x7f13e4042710 con 0x7f13f4109880 2026-02-20T02:25:02.257 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f13d003da80 msgr2=0x7f13d003ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 --2- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f13d003da80 0x7f13d003ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f13e80099c0 tx=0x7f13e8006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 msgr2=0x7f13f419f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 --2- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f419f7a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13e4037b20 tx=0x7f13e40358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 shutdown_connections 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 --2- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f13d003da80 0x7f13d003ff40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 --2- 10.20.193.98:0/1818985204 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f13f4109880 0x7f13f419f7a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 >> 10.20.193.98:0/1818985204 conn(0x7f13f407cf00 msgr2=0x7f13f41070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 shutdown_connections 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.225+0000 7f13fb4e7640 1 -- 10.20.193.98:0/1818985204 wait complete. 2026-02-20T02:25:02.258 INFO:teuthology.orchestra.run.trial098.stdout:mgr is available 2026-02-20T02:25:02.449 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:25:02.449 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout [global] 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout fsid = 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.98:3300,v1:10.20.193.98:6789] 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout [osd] 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.336+0000 7f427a6fa640 1 Processor -- start 2026-02-20T02:25:02.450 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.336+0000 7f427a6fa640 1 -- start start 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.336+0000 7f427a6fa640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f4274109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.336+0000 7f427a6fa640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f427410a250 con 0x7f4274109880 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.337+0000 7f4273fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f4274109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.337+0000 7f4273fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f4274109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44050/0 (socket says 10.20.193.98:44050) 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.337+0000 7f4273fff640 1 -- 10.20.193.98:0/1638127014 learned_addr learned my addr 10.20.193.98:0/1638127014 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.337+0000 7f4273fff640 1 -- 10.20.193.98:0/1638127014 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427410aa80 con 0x7f4274109880 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.337+0000 7f4273fff640 1 --2- 10.20.193.98:0/1638127014 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f4274109c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4260009920 tx=0x7f426002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d1b1271a44d771 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.337+0000 7f4272ffd640 1 -- 10.20.193.98:0/1638127014 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f426003c070 con 0x7f4274109880 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.337+0000 7f4272ffd640 1 -- 10.20.193.98:0/1638127014 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f426002fe00 con 0x7f4274109880 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.337+0000 7f4272ffd640 1 -- 10.20.193.98:0/1638127014 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4260035340 con 0x7f4274109880 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 -- 10.20.193.98:0/1638127014 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 msgr2=0x7f4274109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 --2- 10.20.193.98:0/1638127014 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f4274109c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4260009920 tx=0x7f426002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 -- 10.20.193.98:0/1638127014 shutdown_connections 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 --2- 10.20.193.98:0/1638127014 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f4274109c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 -- 10.20.193.98:0/1638127014 >> 10.20.193.98:0/1638127014 conn(0x7f427407ce10 msgr2=0x7f427407d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 -- 10.20.193.98:0/1638127014 shutdown_connections 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 -- 10.20.193.98:0/1638127014 wait complete. 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 Processor -- start 2026-02-20T02:25:02.451 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 -- start start 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f427419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f427a6fa640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f427410dcb0 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f4273fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f427419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f4273fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f427419f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44064/0 (socket says 10.20.193.98:44064) 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f4273fff640 1 -- 10.20.193.98:0/4028202324 learned_addr learned my addr 10.20.193.98:0/4028202324 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f4273fff640 1 -- 10.20.193.98:0/4028202324 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427419fc70 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.338+0000 7f4273fff640 1 --2- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f427419f730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4260037b20 tx=0x7f42600358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f42717fa640 1 -- 10.20.193.98:0/4028202324 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4260035c10 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427419ff00 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f42717fa640 1 -- 10.20.193.98:0/4028202324 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f4260035db0 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f42717fa640 1 -- 10.20.193.98:0/4028202324 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f42600413a0 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42741a2bf0 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4274109d00 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f42717fa640 1 -- 10.20.193.98:0/4028202324 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 4) ==== 50250+0+0 (secure 0 0 0) 0x7f42600423f0 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f42717fa640 1 --2- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f424803db50 0x7f4248040010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f42717fa640 1 -- 10.20.193.98:0/4028202324 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f42600763b0 con 0x7f4274109880 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.339+0000 7f42737fe640 1 --2- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f424803db50 0x7f4248040010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.340+0000 7f42737fe640 1 --2- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f424803db50 0x7f4248040010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42640099c0 tx=0x7f4264006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:02.452 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.342+0000 7f42717fa640 1 -- 10.20.193.98:0/4028202324 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4260076110 con 0x7f4274109880 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.424+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f42741a44d0 con 0x7f4274109880 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.425+0000 7f42717fa640 1 -- 10.20.193.98:0/4028202324 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+374 (secure 0 0 0) 0x7f4260042710 con 0x7f4274109880 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.425+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f424803db50 msgr2=0x7f4248040010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.425+0000 7f427a6fa640 1 --2- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f424803db50 0x7f4248040010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42640099c0 tx=0x7f4264006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.425+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 msgr2=0x7f427419f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.425+0000 7f427a6fa640 1 --2- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f427419f730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4260037b20 tx=0x7f42600358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.425+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 shutdown_connections 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.425+0000 7f427a6fa640 1 --2- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f424803db50 0x7f4248040010 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.426+0000 7f427a6fa640 1 --2- 10.20.193.98:0/4028202324 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4274109880 0x7f427419f730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.426+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 >> 10.20.193.98:0/4028202324 conn(0x7f427407ce10 msgr2=0x7f4274107090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.426+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 shutdown_connections 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.426+0000 7f427a6fa640 1 -- 10.20.193.98:0/4028202324 wait complete. 2026-02-20T02:25:02.453 INFO:teuthology.orchestra.run.trial098.stdout:Enabling cephadm module... 2026-02-20T02:25:02.543 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:02 trial098 ceph-mon[38923]: mgrmap e3: trial098.hiicxh(active, since 1.00521s) 2026-02-20T02:25:02.544 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:02 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1818985204' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T02:25:03.351 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.542+0000 7f7af3b26640 1 Processor -- start 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.542+0000 7f7af3b26640 1 -- start start 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.542+0000 7f7af3b26640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec07e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.542+0000 7f7af3b26640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec07eba0 con 0x7f7aec07e1d0 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.543+0000 7f7af189b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec07e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.543+0000 7f7af189b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec07e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44070/0 (socket says 10.20.193.98:44070) 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.543+0000 7f7af189b640 1 -- 10.20.193.98:0/1993058008 learned_addr learned my addr 10.20.193.98:0/1993058008 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.543+0000 7f7af189b640 1 -- 10.20.193.98:0/1993058008 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec07f420 con 0x7f7aec07e1d0 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.543+0000 7f7af189b640 1 --2- 10.20.193.98:0/1993058008 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec07e5d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009920 tx=0x7f7adc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59802c69f5c8770b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:03.352 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.543+0000 7f7af0899640 1 -- 10.20.193.98:0/1993058008 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f7adc03c070 con 0x7f7aec07e1d0 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af0899640 1 -- 10.20.193.98:0/1993058008 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f7adc02fe00 con 0x7f7aec07e1d0 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af0899640 1 -- 10.20.193.98:0/1993058008 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f7adc035340 con 0x7f7aec07e1d0 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 -- 10.20.193.98:0/1993058008 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 msgr2=0x7f7aec07e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 --2- 10.20.193.98:0/1993058008 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec07e5d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009920 tx=0x7f7adc02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 -- 10.20.193.98:0/1993058008 shutdown_connections 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 --2- 10.20.193.98:0/1993058008 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec07e5d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 -- 10.20.193.98:0/1993058008 >> 10.20.193.98:0/1993058008 conn(0x7f7aec07cf00 msgr2=0x7f7aec07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 -- 10.20.193.98:0/1993058008 shutdown_connections 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 -- 10.20.193.98:0/1993058008 wait complete. 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 Processor -- start 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 -- start start 2026-02-20T02:25:03.353 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec1a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af3b26640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec080660 con 0x7f7aec07e1d0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af189b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec1a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af189b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec1a3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44082/0 (socket says 10.20.193.98:44082) 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.544+0000 7f7af189b640 1 -- 10.20.193.98:0/2049024281 learned_addr learned my addr 10.20.193.98:0/2049024281 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7af189b640 1 -- 10.20.193.98:0/2049024281 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec1a4140 con 0x7f7aec07e1d0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7af189b640 1 --2- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec1a3c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7adc037b20 tx=0x7f7adc0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7adaffd640 1 -- 10.20.193.98:0/2049024281 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f7adc0378f0 con 0x7f7aec07e1d0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec1a43d0 con 0x7f7aec07e1d0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7adaffd640 1 -- 10.20.193.98:0/2049024281 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f7adc035c90 con 0x7f7aec07e1d0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7adaffd640 1 -- 10.20.193.98:0/2049024281 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f7adc041550 con 0x7f7aec07e1d0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec1a70c0 con 0x7f7aec07e1d0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec07e5d0 con 0x7f7aec07e1d0 2026-02-20T02:25:03.354 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7adaffd640 1 -- 10.20.193.98:0/2049024281 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 4) ==== 50250+0+0 (secure 0 0 0) 0x7f7adc0428d0 con 0x7f7aec07e1d0 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7adaffd640 1 --2- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f7ac803db50 0x7f7ac8040010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.545+0000 7f7adaffd640 1 -- 10.20.193.98:0/2049024281 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7adc076330 con 0x7f7aec07e1d0 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.546+0000 7f7af109a640 1 --2- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f7ac803db50 0x7f7ac8040010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.546+0000 7f7af109a640 1 --2- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f7ac803db50 0x7f7ac8040010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00099c0 tx=0x7f7ae0006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.548+0000 7f7adaffd640 1 -- 10.20.193.98:0/2049024281 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f7adc03e200 con 0x7f7aec07e1d0 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:02.651+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f7aec19d050 con 0x7f7aec07e1d0 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.323+0000 7f7adaffd640 1 -- 10.20.193.98:0/2049024281 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f7adc076090 con 0x7f7aec07e1d0 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.325+0000 7f7adaffd640 1 -- 10.20.193.98:0/2049024281 <== mon.0 v2:10.20.193.98:3300/0 8 ==== mgrmap(e 5) ==== 50261+0+0 (secure 0 0 0) 0x7f7adc041810 con 0x7f7aec07e1d0 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f7ac803db50 msgr2=0x7f7ac8040010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 --2- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f7ac803db50 0x7f7ac8040010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00099c0 tx=0x7f7ae0006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.355 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 msgr2=0x7f7aec1a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:03.356 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 --2- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec1a3c00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7adc037b20 tx=0x7f7adc0358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.356 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 shutdown_connections 2026-02-20T02:25:03.356 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 --2- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f7ac803db50 0x7f7ac8040010 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.356 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 --2- 10.20.193.98:0/2049024281 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7aec07e1d0 0x7f7aec1a3c00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.356 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 >> 10.20.193.98:0/2049024281 conn(0x7f7aec07cf00 msgr2=0x7f7aec1082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:03.356 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 shutdown_connections 2026-02-20T02:25:03.356 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.326+0000 7f7af3b26640 1 -- 10.20.193.98:0/2049024281 wait complete. 2026-02-20T02:25:03.578 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:03 trial098 ceph-mon[38923]: mgrmap e4: trial098.hiicxh(active, since 2s) 2026-02-20T02:25:03.578 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:03 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4028202324' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-20T02:25:03.578 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:03 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2049024281' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-20T02:25:03.592 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout { 2026-02-20T02:25:03.592 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-20T02:25:03.592 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T02:25:03.592 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "active_name": "trial098.hiicxh", 2026-02-20T02:25:03.593 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-20T02:25:03.593 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout } 2026-02-20T02:25:03.593 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.449+0000 7f8c213f2640 1 Processor -- start 2026-02-20T02:25:03.593 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.449+0000 7f8c213f2640 1 -- start start 2026-02-20T02:25:03.593 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c213f2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:03.593 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c213f2640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c10a250 con 0x7f8c1c109880 2026-02-20T02:25:03.593 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c1affd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:03.594 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c1affd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44108/0 (socket says 10.20.193.98:44108) 2026-02-20T02:25:03.594 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c1affd640 1 -- 10.20.193.98:0/3183148537 learned_addr learned my addr 10.20.193.98:0/3183148537 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:03.594 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c1affd640 1 -- 10.20.193.98:0/3183148537 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c10aa80 con 0x7f8c1c109880 2026-02-20T02:25:03.594 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c1affd640 1 --2- 10.20.193.98:0/3183148537 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c109c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009920 tx=0x7f8c1002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cd73e16fb03bb3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:03.594 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c19ffb640 1 -- 10.20.193.98:0/3183148537 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8c1003c070 con 0x7f8c1c109880 2026-02-20T02:25:03.594 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c19ffb640 1 -- 10.20.193.98:0/3183148537 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f8c1002fe00 con 0x7f8c1c109880 2026-02-20T02:25:03.594 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.450+0000 7f8c19ffb640 1 -- 10.20.193.98:0/3183148537 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8c10035340 con 0x7f8c1c109880 2026-02-20T02:25:03.594 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 -- 10.20.193.98:0/3183148537 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 msgr2=0x7f8c1c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:03.595 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 --2- 10.20.193.98:0/3183148537 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c109c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009920 tx=0x7f8c1002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:03.595 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 -- 10.20.193.98:0/3183148537 shutdown_connections 2026-02-20T02:25:03.595 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 --2- 10.20.193.98:0/3183148537 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c109c80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.595 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 -- 10.20.193.98:0/3183148537 >> 10.20.193.98:0/3183148537 conn(0x7f8c1c07cf00 msgr2=0x7f8c1c07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:03.595 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 -- 10.20.193.98:0/3183148537 shutdown_connections 2026-02-20T02:25:03.595 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 -- 10.20.193.98:0/3183148537 wait complete. 2026-02-20T02:25:03.595 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 Processor -- start 2026-02-20T02:25:03.595 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 -- start start 2026-02-20T02:25:03.596 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:03.596 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c213f2640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c10dcb0 con 0x7f8c1c109880 2026-02-20T02:25:03.596 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c1affd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:03.596 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c1affd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c19f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44116/0 (socket says 10.20.193.98:44116) 2026-02-20T02:25:03.596 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c1affd640 1 -- 10.20.193.98:0/1203565404 learned_addr learned my addr 10.20.193.98:0/1203565404 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:03.596 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c1affd640 1 -- 10.20.193.98:0/1203565404 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c19fce0 con 0x7f8c1c109880 2026-02-20T02:25:03.596 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.451+0000 7f8c1affd640 1 --2- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c19f7a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8c10037b20 tx=0x7f8c100358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:03.596 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8bfbfff640 1 -- 10.20.193.98:0/1203565404 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8c10035c10 con 0x7f8c1c109880 2026-02-20T02:25:03.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8bfbfff640 1 -- 10.20.193.98:0/1203565404 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f8c10035db0 con 0x7f8c1c109880 2026-02-20T02:25:03.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8bfbfff640 1 -- 10.20.193.98:0/1203565404 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8c100413a0 con 0x7f8c1c109880 2026-02-20T02:25:03.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c19ff70 con 0x7f8c1c109880 2026-02-20T02:25:03.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c1a2c60 con 0x7f8c1c109880 2026-02-20T02:25:03.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c109d00 con 0x7f8c1c109880 2026-02-20T02:25:03.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8bfbfff640 1 -- 10.20.193.98:0/1203565404 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 5) ==== 50261+0+0 (secure 0 0 0) 0x7f8c100423f0 con 0x7f8c1c109880 2026-02-20T02:25:03.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8bfbfff640 1 --2- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f8bf003dbf0 0x7f8bf00400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:03.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8c1a7fc640 1 -- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f8bf003dbf0 msgr2=0x7f8bf00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/802451532 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8bfbfff640 1 -- 10.20.193.98:0/1203565404 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8c100763c0 con 0x7f8c1c109880 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.452+0000 7f8c1a7fc640 1 --2- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f8bf003dbf0 0x7f8bf00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.455+0000 7f8bfbfff640 1 -- 10.20.193.98:0/1203565404 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8c10076120 con 0x7f8c1c109880 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.561+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8c1c1a33c0 con 0x7f8c1c109880 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.561+0000 7f8bfbfff640 1 -- 10.20.193.98:0/1203565404 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+102 (secure 0 0 0) 0x7f8c10041600 con 0x7f8c1c109880 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f8bf003dbf0 msgr2=0x7f8bf00400b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 --2- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f8bf003dbf0 0x7f8bf00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 msgr2=0x7f8c1c19f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 --2- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c19f7a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8c10037b20 tx=0x7f8c100358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 shutdown_connections 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 --2- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f8bf003dbf0 0x7f8bf00400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 --2- 10.20.193.98:0/1203565404 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8c1c109880 0x7f8c1c19f7a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:03.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 >> 10.20.193.98:0/1203565404 conn(0x7f8c1c07cf00 msgr2=0x7f8c1c1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:03.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 shutdown_connections 2026-02-20T02:25:03.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.562+0000 7f8c213f2640 1 -- 10.20.193.98:0/1203565404 wait complete. 2026-02-20T02:25:03.599 INFO:teuthology.orchestra.run.trial098.stdout:Waiting for the mgr to restart... 2026-02-20T02:25:03.599 INFO:teuthology.orchestra.run.trial098.stdout:Waiting for mgr epoch 5... 2026-02-20T02:25:04.415 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:04 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2049024281' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-20T02:25:04.415 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:04 trial098 ceph-mon[38923]: mgrmap e5: trial098.hiicxh(active, since 3s) 2026-02-20T02:25:04.415 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:04 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1203565404' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-20T02:25:06.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: Active manager daemon trial098.hiicxh restarted 2026-02-20T02:25:06.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: Activating manager daemon trial098.hiicxh 2026-02-20T02:25:06.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: osdmap e2: 0 total, 0 up, 0 in 2026-02-20T02:25:06.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: mgrmap e6: trial098.hiicxh(active, starting, since 0.00257392s) 2026-02-20T02:25:06.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:25:06.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr metadata", "who": "trial098.hiicxh", "id": "trial098.hiicxh"}]: dispatch 2026-02-20T02:25:06.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T02:25:06.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T02:25:06.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T02:25:06.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: Manager daemon trial098.hiicxh is now available 2026-02-20T02:25:06.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:06.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:06.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:06.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:06.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial098.hiicxh/mirror_snapshot_schedule"}]: dispatch 2026-02-20T02:25:06.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:06 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial098.hiicxh/trash_purge_schedule"}]: dispatch 2026-02-20T02:25:07.011 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout { 2026-02-20T02:25:07.011 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-20T02:25:07.011 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-20T02:25:07.011 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout } 2026-02-20T02:25:07.011 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.683+0000 7f16d1443640 1 Processor -- start 2026-02-20T02:25:07.011 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.683+0000 7f16d1443640 1 -- start start 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.683+0000 7f16d1443640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.683+0000 7f16d1443640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc10a250 con 0x7f16cc109880 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.684+0000 7f16caffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.684+0000 7f16caffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44132/0 (socket says 10.20.193.98:44132) 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.684+0000 7f16caffd640 1 -- 10.20.193.98:0/1863715248 learned_addr learned my addr 10.20.193.98:0/1863715248 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.684+0000 7f16caffd640 1 -- 10.20.193.98:0/1863715248 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc10aa80 con 0x7f16cc109880 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.684+0000 7f16caffd640 1 --2- 10.20.193.98:0/1863715248 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc109c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009920 tx=0x7f16c002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da31680e5aae11e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.684+0000 7f16c9ffb640 1 -- 10.20.193.98:0/1863715248 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f16c003c070 con 0x7f16cc109880 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.684+0000 7f16c9ffb640 1 -- 10.20.193.98:0/1863715248 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f16c002fe00 con 0x7f16cc109880 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.684+0000 7f16c9ffb640 1 -- 10.20.193.98:0/1863715248 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f16c0035340 con 0x7f16cc109880 2026-02-20T02:25:07.012 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 -- 10.20.193.98:0/1863715248 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 msgr2=0x7f16cc109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 --2- 10.20.193.98:0/1863715248 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc109c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009920 tx=0x7f16c002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 -- 10.20.193.98:0/1863715248 shutdown_connections 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 --2- 10.20.193.98:0/1863715248 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc109c80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 -- 10.20.193.98:0/1863715248 >> 10.20.193.98:0/1863715248 conn(0x7f16cc07cf00 msgr2=0x7f16cc07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 -- 10.20.193.98:0/1863715248 shutdown_connections 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 -- 10.20.193.98:0/1863715248 wait complete. 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 Processor -- start 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 -- start start 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16d1443640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc10dcb0 con 0x7f16cc109880 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16caffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc19f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.013 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16caffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc19f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44136/0 (socket says 10.20.193.98:44136) 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16caffd640 1 -- 10.20.193.98:0/2446963621 learned_addr learned my addr 10.20.193.98:0/2446963621 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16caffd640 1 -- 10.20.193.98:0/2446963621 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc19fcd0 con 0x7f16cc109880 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16caffd640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc19f790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f16c0037b20 tx=0x7f16c00358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.685+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f16c0035c10 con 0x7f16cc109880 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f16c0035db0 con 0x7f16cc109880 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f16c00413a0 con 0x7f16cc109880 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16cc19ff60 con 0x7f16cc109880 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16cc1a2c50 con 0x7f16cc109880 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 5) ==== 50261+0+0 (secure 0 0 0) 0x7f16c00423f0 con 0x7f16cc109880 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16abfff640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 0x7f16a00400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.014 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 --> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f16a00407c0 con 0x7f16a003dbf0 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16ca7fc640 1 -- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 msgr2=0x7f16a00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/802451532 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16c00763a0 con 0x7f16cc109880 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.686+0000 7f16ca7fc640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 0x7f16a00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.887+0000 7f16ca7fc640 1 -- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 msgr2=0x7f16a00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/802451532 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:03.887+0000 7f16ca7fc640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 0x7f16a00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:04.288+0000 7f16ca7fc640 1 -- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 msgr2=0x7f16a00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/802451532 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:04.288+0000 7f16ca7fc640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 0x7f16a00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:05.089+0000 7f16ca7fc640 1 -- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 msgr2=0x7f16a00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/802451532 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:05.089+0000 7f16ca7fc640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 0x7f16a00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:05.976+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mgrmap(e 6) ==== 50028+0+0 (secure 0 0 0) 0x7f16c00751a0 con 0x7f16cc109880 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:05.976+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 msgr2=0x7f16a00400b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T02:25:07.015 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:05.976+0000 7f16abfff640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 0x7f16a00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.977+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f16c00758a0 con 0x7f16cc109880 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.977+0000 7f16abfff640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f16a0041540 0x7f16a0043930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.977+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f16c003eec0 con 0x7f16a0041540 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.977+0000 7f16ca7fc640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f16a0041540 0x7f16a0043930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.978+0000 7f16ca7fc640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f16a0041540 0x7f16a0043930 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16b4003a80 tx=0x7f16b40092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.978+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f16c003eec0 con 0x7f16a0041540 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f16cc109d00 con 0x7f16a0041540 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16abfff640 1 -- 10.20.193.98:0/2446963621 <== mgr.14118 v2:10.20.193.98:6800/2682971939 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f16cc109d00 con 0x7f16a0041540 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f16a0041540 msgr2=0x7f16a0043930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f16a0041540 0x7f16a0043930 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16b4003a80 tx=0x7f16b40092b0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.016 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 msgr2=0x7f16cc19f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc19f790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f16c0037b20 tx=0x7f16c00358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 shutdown_connections 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/802451532,v1:10.20.193.98:6801/802451532] conn(0x7f16a003dbf0 0x7f16a00400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f16a0041540 0x7f16a0043930 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 --2- 10.20.193.98:0/2446963621 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16cc109880 0x7f16cc19f790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 >> 10.20.193.98:0/2446963621 conn(0x7f16cc07cf00 msgr2=0x7f16cc1070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 shutdown_connections 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:06.983+0000 7f16d1443640 1 -- 10.20.193.98:0/2446963621 wait complete. 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:mgr epoch 5 is available 2026-02-20T02:25:07.017 INFO:teuthology.orchestra.run.trial098.stdout:Setting orchestrator backend to cephadm... 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.104+0000 7f8218367640 1 Processor -- start 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.104+0000 7f8218367640 1 -- start start 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.104+0000 7f8218367640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f8210109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.104+0000 7f8218367640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f821010a250 con 0x7f8210109880 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.104+0000 7f82160dc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f8210109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.104+0000 7f82160dc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f8210109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44214/0 (socket says 10.20.193.98:44214) 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.104+0000 7f82160dc640 1 -- 10.20.193.98:0/3275111867 learned_addr learned my addr 10.20.193.98:0/3275111867 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.104+0000 7f82160dc640 1 -- 10.20.193.98:0/3275111867 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821010aa80 con 0x7f8210109880 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f82160dc640 1 --2- 10.20.193.98:0/3275111867 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f8210109c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8200009920 tx=0x7f820002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596a39ab343a18b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f82150da640 1 -- 10.20.193.98:0/3275111867 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f820003c070 con 0x7f8210109880 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f82150da640 1 -- 10.20.193.98:0/3275111867 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f820002fe00 con 0x7f8210109880 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f82150da640 1 -- 10.20.193.98:0/3275111867 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8200035340 con 0x7f8210109880 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 -- 10.20.193.98:0/3275111867 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 msgr2=0x7f8210109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 --2- 10.20.193.98:0/3275111867 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f8210109c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8200009920 tx=0x7f820002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 -- 10.20.193.98:0/3275111867 shutdown_connections 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 --2- 10.20.193.98:0/3275111867 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f8210109c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 -- 10.20.193.98:0/3275111867 >> 10.20.193.98:0/3275111867 conn(0x7f821007cf00 msgr2=0x7f821007d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 -- 10.20.193.98:0/3275111867 shutdown_connections 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 -- 10.20.193.98:0/3275111867 wait complete. 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 Processor -- start 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.105+0000 7f8218367640 1 -- start start 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f8218367640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f821019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f8218367640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f821010dcb0 con 0x7f8210109880 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f82160dc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f821019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f82160dc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f821019f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44224/0 (socket says 10.20.193.98:44224) 2026-02-20T02:25:07.225 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f82160dc640 1 -- 10.20.193.98:0/954490411 learned_addr learned my addr 10.20.193.98:0/954490411 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f82160dc640 1 -- 10.20.193.98:0/954490411 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821019fce0 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f82160dc640 1 --2- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f821019f7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8200037b20 tx=0x7f82000358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f81f77fe640 1 -- 10.20.193.98:0/954490411 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8200035c10 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f81f77fe640 1 -- 10.20.193.98:0/954490411 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f8200035db0 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821019ff70 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f81f77fe640 1 -- 10.20.193.98:0/954490411 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f82000413a0 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82101a2c60 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.106+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8210109d00 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.107+0000 7f81f77fe640 1 -- 10.20.193.98:0/954490411 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f82000423f0 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.107+0000 7f81f77fe640 1 --2- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f81ec03dad0 0x7f81ec03ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.107+0000 7f81f77fe640 1 -- 10.20.193.98:0/954490411 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8200076540 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.107+0000 7f82158db640 1 --2- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f81ec03dad0 0x7f81ec03ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.107+0000 7f82158db640 1 --2- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f81ec03dad0 0x7f81ec03ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82040099c0 tx=0x7f8204006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.110+0000 7f81f77fe640 1 -- 10.20.193.98:0/954490411 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8200041600 con 0x7f8210109880 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.199+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f82101077d0 con 0x7f81ec03dad0 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.203+0000 7f81f77fe640 1 -- 10.20.193.98:0/954490411 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f82101077d0 con 0x7f81ec03dad0 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f81ec03dad0 msgr2=0x7f81ec03ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 --2- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f81ec03dad0 0x7f81ec03ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82040099c0 tx=0x7f8204006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 msgr2=0x7f821019f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 --2- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f821019f7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8200037b20 tx=0x7f82000358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 shutdown_connections 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 --2- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f81ec03dad0 0x7f81ec03ff90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 --2- 10.20.193.98:0/954490411 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8210109880 0x7f821019f7a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 >> 10.20.193.98:0/954490411 conn(0x7f821007cf00 msgr2=0x7f82101070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 shutdown_connections 2026-02-20T02:25:07.226 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.204+0000 7f8218367640 1 -- 10.20.193.98:0/954490411 wait complete. 2026-02-20T02:25:07.428 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-20T02:25:07.428 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.313+0000 7f5ca55d3640 1 Processor -- start 2026-02-20T02:25:07.428 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.313+0000 7f5ca55d3640 1 -- start start 2026-02-20T02:25:07.428 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.313+0000 7f5ca55d3640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca0109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.428 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.313+0000 7f5ca55d3640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010a250 con 0x7f5ca0109880 2026-02-20T02:25:07.428 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.313+0000 7f5c9effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca0109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.428 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.313+0000 7f5c9effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca0109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44240/0 (socket says 10.20.193.98:44240) 2026-02-20T02:25:07.428 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.313+0000 7f5c9effd640 1 -- 10.20.193.98:0/283248726 learned_addr learned my addr 10.20.193.98:0/283248726 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5c9effd640 1 -- 10.20.193.98:0/283248726 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca010aa80 con 0x7f5ca0109880 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5c9effd640 1 --2- 10.20.193.98:0/283248726 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca0109c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009920 tx=0x7f5c9402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1e040dfac109ad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5c9dffb640 1 -- 10.20.193.98:0/283248726 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5c9403c070 con 0x7f5ca0109880 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5c9dffb640 1 -- 10.20.193.98:0/283248726 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f5c9402fe00 con 0x7f5ca0109880 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5c9dffb640 1 -- 10.20.193.98:0/283248726 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5c94035340 con 0x7f5ca0109880 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5ca55d3640 1 -- 10.20.193.98:0/283248726 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 msgr2=0x7f5ca0109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5ca55d3640 1 --2- 10.20.193.98:0/283248726 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca0109c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009920 tx=0x7f5c9402ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5ca55d3640 1 -- 10.20.193.98:0/283248726 shutdown_connections 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5ca55d3640 1 --2- 10.20.193.98:0/283248726 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca0109c80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5ca55d3640 1 -- 10.20.193.98:0/283248726 >> 10.20.193.98:0/283248726 conn(0x7f5ca007cf00 msgr2=0x7f5ca007d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5ca55d3640 1 -- 10.20.193.98:0/283248726 shutdown_connections 2026-02-20T02:25:07.429 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.314+0000 7f5ca55d3640 1 -- 10.20.193.98:0/283248726 wait complete. 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5ca55d3640 1 Processor -- start 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5ca55d3640 1 -- start start 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5ca55d3640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5ca55d3640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010dcb0 con 0x7f5ca0109880 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5c9effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5c9effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca019f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44242/0 (socket says 10.20.193.98:44242) 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5c9effd640 1 -- 10.20.193.98:0/2433350958 learned_addr learned my addr 10.20.193.98:0/2433350958 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5c9effd640 1 -- 10.20.193.98:0/2433350958 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca019fcd0 con 0x7f5ca0109880 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5c9effd640 1 --2- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca019f790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5c94037b20 tx=0x7f5c940358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5c7ffff640 1 -- 10.20.193.98:0/2433350958 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5c94035c10 con 0x7f5ca0109880 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5c7ffff640 1 -- 10.20.193.98:0/2433350958 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f5c94035db0 con 0x7f5ca0109880 2026-02-20T02:25:07.430 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca019ff60 con 0x7f5ca0109880 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5c7ffff640 1 -- 10.20.193.98:0/2433350958 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5c940413a0 con 0x7f5ca0109880 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.315+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01a2c50 con 0x7f5ca0109880 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.316+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca0109d00 con 0x7f5ca0109880 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.316+0000 7f5c7ffff640 1 -- 10.20.193.98:0/2433350958 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f5c940423f0 con 0x7f5ca0109880 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.316+0000 7f5c7ffff640 1 --2- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5c7403dad0 0x7f5c7403ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.316+0000 7f5c7ffff640 1 -- 10.20.193.98:0/2433350958 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5c940765a0 con 0x7f5ca0109880 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.316+0000 7f5c9e7fc640 1 --2- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5c7403dad0 0x7f5c7403ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.317+0000 7f5c9e7fc640 1 --2- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5c7403dad0 0x7f5c7403ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c880099c0 tx=0x7f5c88006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.319+0000 7f5c7ffff640 1 -- 10.20.193.98:0/2433350958 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5c94041600 con 0x7f5ca0109880 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.403+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5ca01077b0 con 0x7f5c7403dad0 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5c7ffff640 1 -- 10.20.193.98:0/2433350958 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5ca01077b0 con 0x7f5c7403dad0 2026-02-20T02:25:07.431 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5c7403dad0 msgr2=0x7f5c7403ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5ca55d3640 1 --2- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5c7403dad0 0x7f5c7403ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c880099c0 tx=0x7f5c88006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 msgr2=0x7f5ca019f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5ca55d3640 1 --2- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca019f790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5c94037b20 tx=0x7f5c940358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 shutdown_connections 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5ca55d3640 1 --2- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5c7403dad0 0x7f5c7403ff90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5ca55d3640 1 --2- 10.20.193.98:0/2433350958 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ca0109880 0x7f5ca019f790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.404+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 >> 10.20.193.98:0/2433350958 conn(0x7f5ca007cf00 msgr2=0x7f5ca01070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.405+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 shutdown_connections 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.405+0000 7f5ca55d3640 1 -- 10.20.193.98:0/2433350958 wait complete. 2026-02-20T02:25:07.432 INFO:teuthology.orchestra.run.trial098.stdout:Generating ssh key... 2026-02-20T02:25:07.517 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:07 trial098 ceph-mon[38923]: Found migration_current of "None". Setting to last migration. 2026-02-20T02:25:07.517 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:07 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:07.517 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:07 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:07.517 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:07 trial098 ceph-mon[38923]: mgrmap e7: trial098.hiicxh(active, since 1.00357s) 2026-02-20T02:25:07.517 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:07 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:07.517 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:07 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:07.651 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.515+0000 7f24d6c91640 1 Processor -- start 2026-02-20T02:25:07.652 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.516+0000 7f24d6c91640 1 -- start start 2026-02-20T02:25:07.652 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.516+0000 7f24d6c91640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d0109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.652 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.516+0000 7f24d6c91640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f24d010a250 con 0x7f24d0109880 2026-02-20T02:25:07.652 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.516+0000 7f24d4a06640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d0109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.652 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.516+0000 7f24d4a06640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d0109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44254/0 (socket says 10.20.193.98:44254) 2026-02-20T02:25:07.652 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.516+0000 7f24d4a06640 1 -- 10.20.193.98:0/3392534554 learned_addr learned my addr 10.20.193.98:0/3392534554 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.652 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.516+0000 7f24d4a06640 1 -- 10.20.193.98:0/3392534554 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d010aa80 con 0x7f24d0109880 2026-02-20T02:25:07.652 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.516+0000 7f24d4a06640 1 --2- 10.20.193.98:0/3392534554 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d0109c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009920 tx=0x7f24c002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40a93cc94b3b831 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24c77fe640 1 -- 10.20.193.98:0/3392534554 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f24c003c070 con 0x7f24d0109880 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24c77fe640 1 -- 10.20.193.98:0/3392534554 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f24c002fe00 con 0x7f24d0109880 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24c77fe640 1 -- 10.20.193.98:0/3392534554 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f24c0035340 con 0x7f24d0109880 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 -- 10.20.193.98:0/3392534554 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 msgr2=0x7f24d0109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 --2- 10.20.193.98:0/3392534554 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d0109c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009920 tx=0x7f24c002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 -- 10.20.193.98:0/3392534554 shutdown_connections 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 --2- 10.20.193.98:0/3392534554 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d0109c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 -- 10.20.193.98:0/3392534554 >> 10.20.193.98:0/3392534554 conn(0x7f24d007ce10 msgr2=0x7f24d007d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 -- 10.20.193.98:0/3392534554 shutdown_connections 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 -- 10.20.193.98:0/3392534554 wait complete. 2026-02-20T02:25:07.653 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 Processor -- start 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 -- start start 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.517+0000 7f24d6c91640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f24d010dcb0 con 0x7f24d0109880 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24d4a06640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24d4a06640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d019f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44264/0 (socket says 10.20.193.98:44264) 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24d4a06640 1 -- 10.20.193.98:0/904723721 learned_addr learned my addr 10.20.193.98:0/904723721 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24d4a06640 1 -- 10.20.193.98:0/904723721 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d019fc70 con 0x7f24d0109880 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24d4a06640 1 --2- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d019f730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f24c0037b20 tx=0x7f24c00358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24c5ffb640 1 -- 10.20.193.98:0/904723721 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f24c0035c10 con 0x7f24d0109880 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24c5ffb640 1 -- 10.20.193.98:0/904723721 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f24c0035db0 con 0x7f24d0109880 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d019ff00 con 0x7f24d0109880 2026-02-20T02:25:07.654 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24c5ffb640 1 -- 10.20.193.98:0/904723721 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f24c00413a0 con 0x7f24d0109880 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d01a2bf0 con 0x7f24d0109880 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.518+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d0109d00 con 0x7f24d0109880 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.519+0000 7f24c5ffb640 1 -- 10.20.193.98:0/904723721 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f24c00423f0 con 0x7f24d0109880 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.519+0000 7f24c5ffb640 1 --2- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f24ac03dad0 0x7f24ac03ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.519+0000 7f24c5ffb640 1 -- 10.20.193.98:0/904723721 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f24c0076520 con 0x7f24d0109880 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.519+0000 7f24c7fff640 1 --2- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f24ac03dad0 0x7f24ac03ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.519+0000 7f24c7fff640 1 --2- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f24ac03dad0 0x7f24ac03ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f24b80099c0 tx=0x7f24b8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.522+0000 7f24c5ffb640 1 -- 10.20.193.98:0/904723721 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f24c0042710 con 0x7f24d0109880 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.606+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f24d01077a0 con 0x7f24ac03dad0 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.626+0000 7f24c5ffb640 1 -- 10.20.193.98:0/904723721 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f24d01077a0 con 0x7f24ac03dad0 2026-02-20T02:25:07.655 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f24ac03dad0 msgr2=0x7f24ac03ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 --2- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f24ac03dad0 0x7f24ac03ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f24b80099c0 tx=0x7f24b8006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 msgr2=0x7f24d019f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 --2- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d019f730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f24c0037b20 tx=0x7f24c00358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 shutdown_connections 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 --2- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f24ac03dad0 0x7f24ac03ff90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 --2- 10.20.193.98:0/904723721 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f24d0109880 0x7f24d019f730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 >> 10.20.193.98:0/904723721 conn(0x7f24d007ce10 msgr2=0x7f24d0107090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 shutdown_connections 2026-02-20T02:25:07.656 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.627+0000 7f24d6c91640 1 -- 10.20.193.98:0/904723721 wait complete. 2026-02-20T02:25:07.859 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIByUJXqxozbPbtthyfGmD4mk8CIC0C1WjY6CRKo9eU+M ceph-5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:25:07.859 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.745+0000 7f16c186d640 1 Processor -- start 2026-02-20T02:25:07.859 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.745+0000 7f16c186d640 1 -- start start 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.745+0000 7f16c186d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.745+0000 7f16c186d640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc10a250 con 0x7f16bc109880 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.745+0000 7f16baffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.745+0000 7f16baffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44270/0 (socket says 10.20.193.98:44270) 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.745+0000 7f16baffd640 1 -- 10.20.193.98:0/3900174481 learned_addr learned my addr 10.20.193.98:0/3900174481 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.745+0000 7f16baffd640 1 -- 10.20.193.98:0/3900174481 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc10aa80 con 0x7f16bc109880 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16baffd640 1 --2- 10.20.193.98:0/3900174481 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc109c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009920 tx=0x7f16b002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cd518b8a14ad42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16b9ffb640 1 -- 10.20.193.98:0/3900174481 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f16b003c070 con 0x7f16bc109880 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16b9ffb640 1 -- 10.20.193.98:0/3900174481 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f16b002fe00 con 0x7f16bc109880 2026-02-20T02:25:07.860 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16b9ffb640 1 -- 10.20.193.98:0/3900174481 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f16b0035340 con 0x7f16bc109880 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16c186d640 1 -- 10.20.193.98:0/3900174481 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 msgr2=0x7f16bc109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16c186d640 1 --2- 10.20.193.98:0/3900174481 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc109c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009920 tx=0x7f16b002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16c186d640 1 -- 10.20.193.98:0/3900174481 shutdown_connections 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16c186d640 1 --2- 10.20.193.98:0/3900174481 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc109c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16c186d640 1 -- 10.20.193.98:0/3900174481 >> 10.20.193.98:0/3900174481 conn(0x7f16bc07cf00 msgr2=0x7f16bc07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16c186d640 1 -- 10.20.193.98:0/3900174481 shutdown_connections 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.746+0000 7f16c186d640 1 -- 10.20.193.98:0/3900174481 wait complete. 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c186d640 1 Processor -- start 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c186d640 1 -- start start 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c186d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.861 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c186d640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc10dcb0 con 0x7f16bc109880 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16baffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16baffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc19f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44280/0 (socket says 10.20.193.98:44280) 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16baffd640 1 -- 10.20.193.98:0/2814127454 learned_addr learned my addr 10.20.193.98:0/2814127454 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16baffd640 1 -- 10.20.193.98:0/2814127454 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc19fce0 con 0x7f16bc109880 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16baffd640 1 --2- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc19f7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16b0037b20 tx=0x7f16b00358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c086b640 1 -- 10.20.193.98:0/2814127454 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f16b0035c10 con 0x7f16bc109880 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc19ff70 con 0x7f16bc109880 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c086b640 1 -- 10.20.193.98:0/2814127454 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f16b0035db0 con 0x7f16bc109880 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c086b640 1 -- 10.20.193.98:0/2814127454 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f16b00413a0 con 0x7f16bc109880 2026-02-20T02:25:07.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.747+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc1a2c60 con 0x7f16bc109880 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.748+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16bc1a0450 con 0x7f16bc109880 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.748+0000 7f16c086b640 1 -- 10.20.193.98:0/2814127454 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f16b0041650 con 0x7f16bc109880 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.748+0000 7f16c086b640 1 --2- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f169003dad0 0x7f169003ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.748+0000 7f16c086b640 1 -- 10.20.193.98:0/2814127454 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f16b0076660 con 0x7f16bc109880 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.748+0000 7f16ba7fc640 1 --2- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f169003dad0 0x7f169003ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.748+0000 7f16ba7fc640 1 --2- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f169003dad0 0x7f169003ff90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f16a40099c0 tx=0x7f16a4006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.750+0000 7f16c086b640 1 -- 10.20.193.98:0/2814127454 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f16bc1a0450 con 0x7f16bc109880 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.833+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f16bc1077d0 con 0x7f169003dad0 2026-02-20T02:25:07.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.834+0000 7f16c086b640 1 -- 10.20.193.98:0/2814127454 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (secure 0 0 0) 0x7f16bc1077d0 con 0x7f169003dad0 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.834+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f169003dad0 msgr2=0x7f169003ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 --2- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f169003dad0 0x7f169003ff90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f16a40099c0 tx=0x7f16a4006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 msgr2=0x7f16bc19f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 --2- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc19f7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16b0037b20 tx=0x7f16b00358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 shutdown_connections 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 --2- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f169003dad0 0x7f169003ff90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 --2- 10.20.193.98:0/2814127454 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f16bc109880 0x7f16bc19f7a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 >> 10.20.193.98:0/2814127454 conn(0x7f16bc07cf00 msgr2=0x7f16bc1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:07.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 shutdown_connections 2026-02-20T02:25:07.865 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.835+0000 7f16c186d640 1 -- 10.20.193.98:0/2814127454 wait complete. 2026-02-20T02:25:07.865 INFO:teuthology.orchestra.run.trial098.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-20T02:25:07.865 INFO:teuthology.orchestra.run.trial098.stdout:Adding key to root@localhost authorized_keys... 2026-02-20T02:25:07.865 INFO:teuthology.orchestra.run.trial098.stdout:Adding host trial098... 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:07] ENGINE Bus STARTING 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:07] ENGINE Serving on https://10.20.193.98:7150 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:07] ENGINE Client ('10.20.193.98', 40062) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:08.355 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:08 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:09.473 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:09 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:07] ENGINE Serving on http://10.20.193.98:8765 2026-02-20T02:25:09.474 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:09 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:07] ENGINE Bus STARTED 2026-02-20T02:25:09.474 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:09 trial098 ceph-mon[38923]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:09.474 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:09 trial098 ceph-mon[38923]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:09.474 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:09 trial098 ceph-mon[38923]: Generating ssh key... 2026-02-20T02:25:09.474 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:09 trial098 ceph-mon[38923]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:09.474 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:09 trial098 ceph-mon[38923]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial098", "addr": "10.20.193.98", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:09.475 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:09 trial098 ceph-mon[38923]: mgrmap e8: trial098.hiicxh(active, since 2s) 2026-02-20T02:25:09.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Added host 'trial098' with addr '10.20.193.98' 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.946+0000 7f7869935640 1 Processor -- start 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.946+0000 7f7869935640 1 -- start start 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.946+0000 7f7869935640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f7864109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.946+0000 7f7869935640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f786410a250 con 0x7f7864109880 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.946+0000 7f7862ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f7864109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.946+0000 7f7862ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f7864109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44294/0 (socket says 10.20.193.98:44294) 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.946+0000 7f7862ffd640 1 -- 10.20.193.98:0/136249414 learned_addr learned my addr 10.20.193.98:0/136249414 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.946+0000 7f7862ffd640 1 -- 10.20.193.98:0/136249414 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786410aa80 con 0x7f7864109880 2026-02-20T02:25:09.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7862ffd640 1 --2- 10.20.193.98:0/136249414 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f7864109c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7858009920 tx=0x7f785802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c77f6bbddf047ab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7861ffb640 1 -- 10.20.193.98:0/136249414 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f785803c070 con 0x7f7864109880 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7861ffb640 1 -- 10.20.193.98:0/136249414 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f785802fe00 con 0x7f7864109880 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7861ffb640 1 -- 10.20.193.98:0/136249414 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f7858035340 con 0x7f7864109880 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 -- 10.20.193.98:0/136249414 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 msgr2=0x7f7864109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 --2- 10.20.193.98:0/136249414 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f7864109c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7858009920 tx=0x7f785802ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 -- 10.20.193.98:0/136249414 shutdown_connections 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 --2- 10.20.193.98:0/136249414 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f7864109c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 -- 10.20.193.98:0/136249414 >> 10.20.193.98:0/136249414 conn(0x7f786407cf00 msgr2=0x7f786407d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:09.522 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 -- 10.20.193.98:0/136249414 shutdown_connections 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 -- 10.20.193.98:0/136249414 wait complete. 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 Processor -- start 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 -- start start 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f786419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7869935640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f786410dcb0 con 0x7f7864109880 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7862ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f786419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7862ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f786419f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44306/0 (socket says 10.20.193.98:44306) 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.947+0000 7f7862ffd640 1 -- 10.20.193.98:0/3931446724 learned_addr learned my addr 10.20.193.98:0/3931446724 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7862ffd640 1 -- 10.20.193.98:0/3931446724 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786419fce0 con 0x7f7864109880 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7862ffd640 1 --2- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f786419f7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7858002410 tx=0x7f7858037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.523 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7868933640 1 -- 10.20.193.98:0/3931446724 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f7858035970 con 0x7f7864109880 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7868933640 1 -- 10.20.193.98:0/3931446724 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f78580423f0 con 0x7f7864109880 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7868933640 1 -- 10.20.193.98:0/3931446724 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f78580413a0 con 0x7f7864109880 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f786419ff70 con 0x7f7864109880 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78641a2c60 con 0x7f7864109880 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7864109d00 con 0x7f7864109880 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7868933640 1 -- 10.20.193.98:0/3931446724 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f78580428a0 con 0x7f7864109880 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.948+0000 7f7868933640 1 --2- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f783803dad0 0x7f783803ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.949+0000 7f7868933640 1 -- 10.20.193.98:0/3931446724 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7858076310 con 0x7f7864109880 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.949+0000 7f78627fc640 1 --2- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f783803dad0 0x7f783803ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.949+0000 7f78627fc640 1 --2- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f783803dad0 0x7f783803ff90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f784c0099c0 tx=0x7f784c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.524 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:07.951+0000 7f7868933640 1 -- 10.20.193.98:0/3931446724 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f785803e200 con 0x7f7864109880 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:08.035+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial098", "addr": "10.20.193.98", "target": ["mon-mgr", ""]}) -- 0x7f78641077d0 con 0x7f783803dad0 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:08.627+0000 7f7868933640 1 -- 10.20.193.98:0/3931446724 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f7858033200 con 0x7f7864109880 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.472+0000 7f7868933640 1 -- 10.20.193.98:0/3931446724 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f78641077d0 con 0x7f783803dad0 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f783803dad0 msgr2=0x7f783803ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 --2- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f783803dad0 0x7f783803ff90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f784c0099c0 tx=0x7f784c006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 msgr2=0x7f786419f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 --2- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f786419f7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7858002410 tx=0x7f7858037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 shutdown_connections 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 --2- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f783803dad0 0x7f783803ff90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 --2- 10.20.193.98:0/3931446724 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7864109880 0x7f786419f7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.525 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 >> 10.20.193.98:0/3931446724 conn(0x7f786407cf00 msgr2=0x7f78641070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:09.526 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 shutdown_connections 2026-02-20T02:25:09.526 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.474+0000 7f7869935640 1 -- 10.20.193.98:0/3931446724 wait complete. 2026-02-20T02:25:09.526 INFO:teuthology.orchestra.run.trial098.stdout:Deploying mon service with default placement... 2026-02-20T02:25:09.746 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-20T02:25:09.747 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.619+0000 7f06b0e41640 1 Processor -- start 2026-02-20T02:25:09.747 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.619+0000 7f06b0e41640 1 -- start start 2026-02-20T02:25:09.747 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.619+0000 7f06b0e41640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac07bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.747 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.619+0000 7f06b0e41640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac07c0f0 con 0x7f06ac07d750 2026-02-20T02:25:09.747 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.619+0000 7f06aa575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac07bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.747 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.619+0000 7f06aa575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac07bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32792/0 (socket says 10.20.193.98:32792) 2026-02-20T02:25:09.747 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.619+0000 7f06aa575640 1 -- 10.20.193.98:0/877021482 learned_addr learned my addr 10.20.193.98:0/877021482 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:09.747 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.619+0000 7f06aa575640 1 -- 10.20.193.98:0/877021482 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac07c270 con 0x7f06ac07d750 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06aa575640 1 --2- 10.20.193.98:0/877021482 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac07bbb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009920 tx=0x7f06a002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1060196368c593b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06a9573640 1 -- 10.20.193.98:0/877021482 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f06a003c070 con 0x7f06ac07d750 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06a9573640 1 -- 10.20.193.98:0/877021482 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f06a002fe00 con 0x7f06ac07d750 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06a9573640 1 -- 10.20.193.98:0/877021482 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f06a0035340 con 0x7f06ac07d750 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06b0e41640 1 -- 10.20.193.98:0/877021482 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 msgr2=0x7f06ac07bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06b0e41640 1 --2- 10.20.193.98:0/877021482 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac07bbb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009920 tx=0x7f06a002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06b0e41640 1 -- 10.20.193.98:0/877021482 shutdown_connections 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06b0e41640 1 --2- 10.20.193.98:0/877021482 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac07bbb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06b0e41640 1 -- 10.20.193.98:0/877021482 >> 10.20.193.98:0/877021482 conn(0x7f06ac102dd0 msgr2=0x7f06ac1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06b0e41640 1 -- 10.20.193.98:0/877021482 shutdown_connections 2026-02-20T02:25:09.748 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.620+0000 7f06b0e41640 1 -- 10.20.193.98:0/877021482 wait complete. 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06b0e41640 1 Processor -- start 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06b0e41640 1 -- start start 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06b0e41640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06b0e41640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac10daf0 con 0x7f06ac07d750 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06aa575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06aa575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac19f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32798/0 (socket says 10.20.193.98:32798) 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06aa575640 1 -- 10.20.193.98:0/4224883940 learned_addr learned my addr 10.20.193.98:0/4224883940 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06aa575640 1 -- 10.20.193.98:0/4224883940 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac19fc10 con 0x7f06ac07d750 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06aa575640 1 --2- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac19f6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06a0037b20 tx=0x7f06a00358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.749 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06937fe640 1 -- 10.20.193.98:0/4224883940 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f06a00378f0 con 0x7f06ac07d750 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06937fe640 1 -- 10.20.193.98:0/4224883940 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f06a0035c90 con 0x7f06ac07d750 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ac19fea0 con 0x7f06ac07d750 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06937fe640 1 -- 10.20.193.98:0/4224883940 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f06a0041550 con 0x7f06ac07d750 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.621+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ac1a2b90 con 0x7f06ac07d750 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.622+0000 7f06937fe640 1 -- 10.20.193.98:0/4224883940 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f06a00428d0 con 0x7f06ac07d750 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.622+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ac07bc30 con 0x7f06ac07d750 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.622+0000 7f06937fe640 1 --2- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f068403dbf0 0x7f06840400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.622+0000 7f06937fe640 1 -- 10.20.193.98:0/4224883940 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f06a0076700 con 0x7f06ac07d750 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.622+0000 7f06a9d74640 1 --2- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f068403dbf0 0x7f06840400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.750 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.622+0000 7f06a9d74640 1 --2- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f068403dbf0 0x7f06840400b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f06940099c0 tx=0x7f0694006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.624+0000 7f06937fe640 1 -- 10.20.193.98:0/4224883940 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f06a003e200 con 0x7f06ac07d750 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.716+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) -- 0x7f06ac1040b0 con 0x7f068403dbf0 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.719+0000 7f06937fe640 1 -- 10.20.193.98:0/4224883940 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f06ac1040b0 con 0x7f068403dbf0 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f068403dbf0 msgr2=0x7f06840400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 --2- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f068403dbf0 0x7f06840400b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f06940099c0 tx=0x7f0694006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 msgr2=0x7f06ac19f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 --2- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac19f6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06a0037b20 tx=0x7f06a00358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 shutdown_connections 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 --2- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f068403dbf0 0x7f06840400b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 --2- 10.20.193.98:0/4224883940 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f06ac07d750 0x7f06ac19f6d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.751 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 >> 10.20.193.98:0/4224883940 conn(0x7f06ac102dd0 msgr2=0x7f06ac1039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:09.752 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 shutdown_connections 2026-02-20T02:25:09.752 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.720+0000 7f06b0e41640 1 -- 10.20.193.98:0/4224883940 wait complete. 2026-02-20T02:25:09.752 INFO:teuthology.orchestra.run.trial098.stdout:Deploying mgr service with default placement... 2026-02-20T02:25:09.971 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-20T02:25:09.971 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.843+0000 7f79d62ae640 1 Processor -- start 2026-02-20T02:25:09.971 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.843+0000 7f79d62ae640 1 -- start start 2026-02-20T02:25:09.971 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.843+0000 7f79d62ae640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d007e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.971 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.843+0000 7f79d62ae640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79d007eba0 con 0x7f79d007e1d0 2026-02-20T02:25:09.971 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.843+0000 7f79cffff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d007e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.971 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.843+0000 7f79cffff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d007e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32804/0 (socket says 10.20.193.98:32804) 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.843+0000 7f79cffff640 1 -- 10.20.193.98:0/4062714110 learned_addr learned my addr 10.20.193.98:0/4062714110 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79cffff640 1 -- 10.20.193.98:0/4062714110 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d007f420 con 0x7f79d007e1d0 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79cffff640 1 --2- 10.20.193.98:0/4062714110 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d007e5d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009920 tx=0x7f79bc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e2190ba82c74d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79ceffd640 1 -- 10.20.193.98:0/4062714110 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f79bc03c070 con 0x7f79d007e1d0 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79ceffd640 1 -- 10.20.193.98:0/4062714110 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f79bc02fe00 con 0x7f79d007e1d0 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79ceffd640 1 -- 10.20.193.98:0/4062714110 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f79bc035340 con 0x7f79d007e1d0 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79d62ae640 1 -- 10.20.193.98:0/4062714110 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 msgr2=0x7f79d007e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79d62ae640 1 --2- 10.20.193.98:0/4062714110 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d007e5d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009920 tx=0x7f79bc02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:09.972 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79d62ae640 1 -- 10.20.193.98:0/4062714110 shutdown_connections 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79d62ae640 1 --2- 10.20.193.98:0/4062714110 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d007e5d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79d62ae640 1 -- 10.20.193.98:0/4062714110 >> 10.20.193.98:0/4062714110 conn(0x7f79d007cf00 msgr2=0x7f79d007d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79d62ae640 1 -- 10.20.193.98:0/4062714110 shutdown_connections 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.844+0000 7f79d62ae640 1 -- 10.20.193.98:0/4062714110 wait complete. 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79d62ae640 1 Processor -- start 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79d62ae640 1 -- start start 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79d62ae640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d01a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79d62ae640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0080660 con 0x7f79d007e1d0 2026-02-20T02:25:09.973 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79cffff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d01a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79cffff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d01a3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32812/0 (socket says 10.20.193.98:32812) 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79cffff640 1 -- 10.20.193.98:0/3353611443 learned_addr learned my addr 10.20.193.98:0/3353611443 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79cffff640 1 -- 10.20.193.98:0/3353611443 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d01a41f0 con 0x7f79d007e1d0 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79cffff640 1 --2- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d01a3cb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f79bc037b20 tx=0x7f79bc0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79cd7fa640 1 -- 10.20.193.98:0/3353611443 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f79bc0378f0 con 0x7f79d007e1d0 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79cd7fa640 1 -- 10.20.193.98:0/3353611443 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f79bc035c90 con 0x7f79d007e1d0 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d01a4480 con 0x7f79d007e1d0 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79cd7fa640 1 -- 10.20.193.98:0/3353611443 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f79bc0414f0 con 0x7f79d007e1d0 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.845+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d01a4880 con 0x7f79d007e1d0 2026-02-20T02:25:09.974 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.846+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d007e5d0 con 0x7f79d007e1d0 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.846+0000 7f79cd7fa640 1 -- 10.20.193.98:0/3353611443 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f79bc0428d0 con 0x7f79d007e1d0 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.846+0000 7f79cd7fa640 1 --2- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f79a403dba0 0x7f79a4040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.846+0000 7f79cd7fa640 1 -- 10.20.193.98:0/3353611443 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f79bc0767d0 con 0x7f79d007e1d0 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.846+0000 7f79cf7fe640 1 --2- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f79a403dba0 0x7f79a4040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.847+0000 7f79cf7fe640 1 --2- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f79a403dba0 0x7f79a4040060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f79c00099c0 tx=0x7f79c0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.848+0000 7f79cd7fa640 1 -- 10.20.193.98:0/3353611443 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f79bc03e200 con 0x7f79d007e1d0 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.940+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f79d00630c0 con 0x7f79a403dba0 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.943+0000 7f79cd7fa640 1 -- 10.20.193.98:0/3353611443 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f79d00630c0 con 0x7f79a403dba0 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f79a403dba0 msgr2=0x7f79a4040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 --2- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f79a403dba0 0x7f79a4040060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f79c00099c0 tx=0x7f79c0006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 msgr2=0x7f79d01a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:09.975 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 --2- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d01a3cb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f79bc037b20 tx=0x7f79bc0358c0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.976 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 shutdown_connections 2026-02-20T02:25:09.976 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 --2- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f79a403dba0 0x7f79a4040060 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.976 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 --2- 10.20.193.98:0/3353611443 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f79d007e1d0 0x7f79d01a3cb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:09.976 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 >> 10.20.193.98:0/3353611443 conn(0x7f79d007cf00 msgr2=0x7f79d019a930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:09.976 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 shutdown_connections 2026-02-20T02:25:09.976 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:09.945+0000 7f79d62ae640 1 -- 10.20.193.98:0/3353611443 wait complete. 2026-02-20T02:25:09.977 INFO:teuthology.orchestra.run.trial098.stdout:Deploying crash service with default placement... 2026-02-20T02:25:10.202 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2026-02-20T02:25:10.202 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.068+0000 7f621cfee640 1 Processor -- start 2026-02-20T02:25:10.203 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.068+0000 7f621cfee640 1 -- start start 2026-02-20T02:25:10.203 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.068+0000 7f621cfee640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f6218109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.203 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.068+0000 7f621cfee640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f621810a250 con 0x7f6218109880 2026-02-20T02:25:10.203 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.068+0000 7f6216575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f6218109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.203 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.068+0000 7f6216575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f6218109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32824/0 (socket says 10.20.193.98:32824) 2026-02-20T02:25:10.203 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.068+0000 7f6216575640 1 -- 10.20.193.98:0/76609330 learned_addr learned my addr 10.20.193.98:0/76609330 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:10.204 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.068+0000 7f6216575640 1 -- 10.20.193.98:0/76609330 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621810aa80 con 0x7f6218109880 2026-02-20T02:25:10.204 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f6216575640 1 --2- 10.20.193.98:0/76609330 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f6218109c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f620c009920 tx=0x7f620c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c98d0bc36fd8d72 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.204 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f6215573640 1 -- 10.20.193.98:0/76609330 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f620c03c070 con 0x7f6218109880 2026-02-20T02:25:10.204 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f6215573640 1 -- 10.20.193.98:0/76609330 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f620c02fe20 con 0x7f6218109880 2026-02-20T02:25:10.204 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f6215573640 1 -- 10.20.193.98:0/76609330 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f620c035340 con 0x7f6218109880 2026-02-20T02:25:10.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f621cfee640 1 -- 10.20.193.98:0/76609330 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 msgr2=0x7f6218109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f621cfee640 1 --2- 10.20.193.98:0/76609330 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f6218109c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f620c009920 tx=0x7f620c02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:10.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f621cfee640 1 -- 10.20.193.98:0/76609330 shutdown_connections 2026-02-20T02:25:10.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f621cfee640 1 --2- 10.20.193.98:0/76609330 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f6218109c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.205 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f621cfee640 1 -- 10.20.193.98:0/76609330 >> 10.20.193.98:0/76609330 conn(0x7f621807ce10 msgr2=0x7f621807d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:10.206 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f621cfee640 1 -- 10.20.193.98:0/76609330 shutdown_connections 2026-02-20T02:25:10.206 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.069+0000 7f621cfee640 1 -- 10.20.193.98:0/76609330 wait complete. 2026-02-20T02:25:10.206 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f621cfee640 1 Processor -- start 2026-02-20T02:25:10.206 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f621cfee640 1 -- start start 2026-02-20T02:25:10.206 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f621cfee640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f621819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.206 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f621cfee640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f621810dcb0 con 0x7f6218109880 2026-02-20T02:25:10.206 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f6216575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f621819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.206 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f6216575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f621819f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32836/0 (socket says 10.20.193.98:32836) 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f6216575640 1 -- 10.20.193.98:0/4223209098 learned_addr learned my addr 10.20.193.98:0/4223209098 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f6216575640 1 -- 10.20.193.98:0/4223209098 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621819fc40 con 0x7f6218109880 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f6216575640 1 --2- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f621819f700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f620c0091b0 tx=0x7f620c037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f61ff7fe640 1 -- 10.20.193.98:0/4223209098 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f620c0359a0 con 0x7f6218109880 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f61ff7fe640 1 -- 10.20.193.98:0/4223209098 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f620c043430 con 0x7f6218109880 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621819fed0 con 0x7f6218109880 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f61ff7fe640 1 -- 10.20.193.98:0/4223209098 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f620c042590 con 0x7f6218109880 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.070+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62181a2bc0 con 0x7f6218109880 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.071+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6218109d00 con 0x7f6218109880 2026-02-20T02:25:10.207 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.071+0000 7f61ff7fe640 1 -- 10.20.193.98:0/4223209098 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f620c035b40 con 0x7f6218109880 2026-02-20T02:25:10.208 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.071+0000 7f61ff7fe640 1 --2- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f61f003dbf0 0x7f61f00400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.208 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.071+0000 7f61ff7fe640 1 -- 10.20.193.98:0/4223209098 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f620c076320 con 0x7f6218109880 2026-02-20T02:25:10.208 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.071+0000 7f6215d74640 1 --2- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f61f003dbf0 0x7f61f00400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.208 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.071+0000 7f6215d74640 1 --2- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f61f003dbf0 0x7f61f00400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f62000099c0 tx=0x7f6200006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.208 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.074+0000 7f61ff7fe640 1 -- 10.20.193.98:0/4223209098 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f620c02fdf0 con 0x7f6218109880 2026-02-20T02:25:10.208 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.165+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) -- 0x7f62181076e0 con 0x7f61f003dbf0 2026-02-20T02:25:10.208 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.168+0000 7f61ff7fe640 1 -- 10.20.193.98:0/4223209098 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f62181076e0 con 0x7f61f003dbf0 2026-02-20T02:25:10.208 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.169+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f61f003dbf0 msgr2=0x7f61f00400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.169+0000 7f621cfee640 1 --2- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f61f003dbf0 0x7f61f00400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f62000099c0 tx=0x7f6200006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.169+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 msgr2=0x7f621819f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.169+0000 7f621cfee640 1 --2- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f621819f700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f620c0091b0 tx=0x7f620c037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.169+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 shutdown_connections 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.169+0000 7f621cfee640 1 --2- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f61f003dbf0 0x7f61f00400b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.169+0000 7f621cfee640 1 --2- 10.20.193.98:0/4223209098 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6218109880 0x7f621819f700 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.169+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 >> 10.20.193.98:0/4223209098 conn(0x7f621807ce10 msgr2=0x7f6218106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.170+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 shutdown_connections 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.170+0000 7f621cfee640 1 -- 10.20.193.98:0/4223209098 wait complete. 2026-02-20T02:25:10.209 INFO:teuthology.orchestra.run.trial098.stdout:Deploying ceph-exporter service with default placement... 2026-02-20T02:25:10.416 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2026-02-20T02:25:10.417 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10f8ce640 1 Processor -- start 2026-02-20T02:25:10.417 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10f8ce640 1 -- start start 2026-02-20T02:25:10.417 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10f8ce640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe108109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.417 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10f8ce640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe10810a250 con 0x7fe108109880 2026-02-20T02:25:10.417 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10d643640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe108109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.417 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10d643640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe108109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32852/0 (socket says 10.20.193.98:32852) 2026-02-20T02:25:10.417 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10d643640 1 -- 10.20.193.98:0/2948074399 learned_addr learned my addr 10.20.193.98:0/2948074399 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:10.417 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10d643640 1 -- 10.20.193.98:0/2948074399 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10810aa80 con 0x7fe108109880 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.291+0000 7fe10d643640 1 --2- 10.20.193.98:0/2948074399 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe108109c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009920 tx=0x7fe0f802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a95ae55c77cd0f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe0f7fff640 1 -- 10.20.193.98:0/2948074399 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fe0f803c070 con 0x7fe108109880 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe0f7fff640 1 -- 10.20.193.98:0/2948074399 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fe0f802fe20 con 0x7fe108109880 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe0f7fff640 1 -- 10.20.193.98:0/2948074399 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fe0f8035340 con 0x7fe108109880 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe10f8ce640 1 -- 10.20.193.98:0/2948074399 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 msgr2=0x7fe108109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe10f8ce640 1 --2- 10.20.193.98:0/2948074399 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe108109c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009920 tx=0x7fe0f802ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe10f8ce640 1 -- 10.20.193.98:0/2948074399 shutdown_connections 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe10f8ce640 1 --2- 10.20.193.98:0/2948074399 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe108109c80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe10f8ce640 1 -- 10.20.193.98:0/2948074399 >> 10.20.193.98:0/2948074399 conn(0x7fe10807ce10 msgr2=0x7fe10807d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:10.418 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe10f8ce640 1 -- 10.20.193.98:0/2948074399 shutdown_connections 2026-02-20T02:25:10.419 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe10f8ce640 1 -- 10.20.193.98:0/2948074399 wait complete. 2026-02-20T02:25:10.419 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.292+0000 7fe10f8ce640 1 Processor -- start 2026-02-20T02:25:10.419 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10f8ce640 1 -- start start 2026-02-20T02:25:10.419 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10f8ce640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe10819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.419 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10f8ce640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe10810dcb0 con 0x7fe108109880 2026-02-20T02:25:10.419 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10d643640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe10819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.419 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10d643640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe10819f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32866/0 (socket says 10.20.193.98:32866) 2026-02-20T02:25:10.419 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10d643640 1 -- 10.20.193.98:0/1240584155 learned_addr learned my addr 10.20.193.98:0/1240584155 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10d643640 1 -- 10.20.193.98:0/1240584155 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10819fc10 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10d643640 1 --2- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe10819f6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80091b0 tx=0x7fe0f8037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe0f67fc640 1 -- 10.20.193.98:0/1240584155 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fe0f80359a0 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe0f67fc640 1 -- 10.20.193.98:0/1240584155 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fe0f8043430 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe0f67fc640 1 -- 10.20.193.98:0/1240584155 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fe0f8042590 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10819fea0 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.293+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1081a2b90 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.294+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe108109d00 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.294+0000 7fe0f67fc640 1 -- 10.20.193.98:0/1240584155 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7fe0f8035b40 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.294+0000 7fe0f67fc640 1 --2- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fe0e403dbf0 0x7fe0e40400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.294+0000 7fe0f67fc640 1 -- 10.20.193.98:0/1240584155 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe0f8076320 con 0x7fe108109880 2026-02-20T02:25:10.420 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.294+0000 7fe10ce42640 1 --2- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fe0e403dbf0 0x7fe0e40400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.294+0000 7fe10ce42640 1 --2- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fe0e403dbf0 0x7fe0e40400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0099c0 tx=0x7fe0fc006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.296+0000 7fe0f67fc640 1 -- 10.20.193.98:0/1240584155 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe0f802fdf0 con 0x7fe108109880 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.386+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) -- 0x7fe1081076e0 con 0x7fe0e403dbf0 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.389+0000 7fe0f67fc640 1 -- 10.20.193.98:0/1240584155 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7fe1081076e0 con 0x7fe0e403dbf0 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fe0e403dbf0 msgr2=0x7fe0e40400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 --2- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fe0e403dbf0 0x7fe0e40400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0099c0 tx=0x7fe0fc006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 msgr2=0x7fe10819f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 --2- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe10819f6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80091b0 tx=0x7fe0f8037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 shutdown_connections 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 --2- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fe0e403dbf0 0x7fe0e40400b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.421 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 --2- 10.20.193.98:0/1240584155 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe108109880 0x7fe10819f6d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.422 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 >> 10.20.193.98:0/1240584155 conn(0x7fe10807ce10 msgr2=0x7fe108106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:10.422 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 shutdown_connections 2026-02-20T02:25:10.422 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.390+0000 7fe10f8ce640 1 -- 10.20.193.98:0/1240584155 wait complete. 2026-02-20T02:25:10.422 INFO:teuthology.orchestra.run.trial098.stdout:Deploying prometheus service with default placement... 2026-02-20T02:25:10.508 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:10 trial098 ceph-mon[38923]: Deploying cephadm binary to trial098 2026-02-20T02:25:10.509 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:10 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:10.509 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:10 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:10.509 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:10 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:10.510 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:10 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:10.510 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:10 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:10.510 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:10 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:10.510 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:10 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.515+0000 7fa8cb2bc640 1 Processor -- start 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.515+0000 7fa8cb2bc640 1 -- start start 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.515+0000 7fa8cb2bc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c4109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.515+0000 7fa8cb2bc640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c410a250 con 0x7fa8c4109880 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.515+0000 7fa8c9031640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c4109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.515+0000 7fa8c9031640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c4109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32872/0 (socket says 10.20.193.98:32872) 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.515+0000 7fa8c9031640 1 -- 10.20.193.98:0/271095669 learned_addr learned my addr 10.20.193.98:0/271095669 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.515+0000 7fa8c9031640 1 -- 10.20.193.98:0/271095669 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c410aa80 con 0x7fa8c4109880 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8c9031640 1 --2- 10.20.193.98:0/271095669 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c4109c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009920 tx=0x7fa8b402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbde0beeee4e9493 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8b3fff640 1 -- 10.20.193.98:0/271095669 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa8b403c070 con 0x7fa8c4109880 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8b3fff640 1 -- 10.20.193.98:0/271095669 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa8b402fe20 con 0x7fa8c4109880 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8b3fff640 1 -- 10.20.193.98:0/271095669 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa8b4035340 con 0x7fa8c4109880 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/271095669 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 msgr2=0x7fa8c4109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 --2- 10.20.193.98:0/271095669 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c4109c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009920 tx=0x7fa8b402ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/271095669 shutdown_connections 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 --2- 10.20.193.98:0/271095669 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c4109c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/271095669 >> 10.20.193.98:0/271095669 conn(0x7fa8c407ce10 msgr2=0x7fa8c407d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/271095669 shutdown_connections 2026-02-20T02:25:10.638 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/271095669 wait complete. 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 Processor -- start 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.516+0000 7fa8cb2bc640 1 -- start start 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8cb2bc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c419f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8cb2bc640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c410dcb0 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8c9031640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c419f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8c9031640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c419f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32874/0 (socket says 10.20.193.98:32874) 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8c9031640 1 -- 10.20.193.98:0/3740806084 learned_addr learned my addr 10.20.193.98:0/3740806084 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8c9031640 1 -- 10.20.193.98:0/3740806084 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c419fc40 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8c9031640 1 --2- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c419f700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40091b0 tx=0x7fa8b4037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8b27fc640 1 -- 10.20.193.98:0/3740806084 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa8b40359a0 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8b27fc640 1 -- 10.20.193.98:0/3740806084 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa8b4043430 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c419fed0 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8b27fc640 1 -- 10.20.193.98:0/3740806084 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa8b4042590 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c41a2bc0 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.517+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c4109d00 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.518+0000 7fa8b27fc640 1 -- 10.20.193.98:0/3740806084 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7fa8b4035b40 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.518+0000 7fa8b27fc640 1 --2- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fa8a003dbf0 0x7fa8a00400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.518+0000 7fa8b27fc640 1 -- 10.20.193.98:0/3740806084 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa8b4076330 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.518+0000 7fa8c8830640 1 --2- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fa8a003dbf0 0x7fa8a00400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.518+0000 7fa8c8830640 1 --2- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fa8a003dbf0 0x7fa8a00400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80099c0 tx=0x7fa8b8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.520+0000 7fa8b27fc640 1 -- 10.20.193.98:0/3740806084 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa8b404be10 con 0x7fa8c4109880 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.608+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) -- 0x7fa8c41076e0 con 0x7fa8a003dbf0 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.612+0000 7fa8b27fc640 1 -- 10.20.193.98:0/3740806084 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (secure 0 0 0) 0x7fa8c41076e0 con 0x7fa8a003dbf0 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fa8a003dbf0 msgr2=0x7fa8a00400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 --2- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fa8a003dbf0 0x7fa8a00400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80099c0 tx=0x7fa8b8006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 msgr2=0x7fa8c419f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 --2- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c419f700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40091b0 tx=0x7fa8b4037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 shutdown_connections 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 --2- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fa8a003dbf0 0x7fa8a00400b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 --2- 10.20.193.98:0/3740806084 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8c4109880 0x7fa8c419f700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 >> 10.20.193.98:0/3740806084 conn(0x7fa8c407ce10 msgr2=0x7fa8c4106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 shutdown_connections 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.613+0000 7fa8cb2bc640 1 -- 10.20.193.98:0/3740806084 wait complete. 2026-02-20T02:25:10.639 INFO:teuthology.orchestra.run.trial098.stdout:Deploying grafana service with default placement... 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.733+0000 7f90868f0640 1 Processor -- start 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.733+0000 7f90868f0640 1 -- start start 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f90868f0640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f9080105c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f90868f0640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9080106190 con 0x7f9080105850 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f907ffff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f9080105c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f907ffff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f9080105c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32876/0 (socket says 10.20.193.98:32876) 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f907ffff640 1 -- 10.20.193.98:0/3778033324 learned_addr learned my addr 10.20.193.98:0/3778033324 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f907ffff640 1 -- 10.20.193.98:0/3778033324 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9080106310 con 0x7f9080105850 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f907ffff640 1 --2- 10.20.193.98:0/3778033324 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f9080105c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f906c009920 tx=0x7f906c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b77dee2e7e8904 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f907effd640 1 -- 10.20.193.98:0/3778033324 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f906c03c070 con 0x7f9080105850 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f907effd640 1 -- 10.20.193.98:0/3778033324 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f906c02fe20 con 0x7f9080105850 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.734+0000 7f907effd640 1 -- 10.20.193.98:0/3778033324 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f906c035340 con 0x7f9080105850 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 -- 10.20.193.98:0/3778033324 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 msgr2=0x7f9080105c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 --2- 10.20.193.98:0/3778033324 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f9080105c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f906c009920 tx=0x7f906c02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 -- 10.20.193.98:0/3778033324 shutdown_connections 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 --2- 10.20.193.98:0/3778033324 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f9080105c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 -- 10.20.193.98:0/3778033324 >> 10.20.193.98:0/3778033324 conn(0x7f9080101440 msgr2=0x7f9080103860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 -- 10.20.193.98:0/3778033324 shutdown_connections 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 -- 10.20.193.98:0/3778033324 wait complete. 2026-02-20T02:25:10.862 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 Processor -- start 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 -- start start 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f908019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f90868f0640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9080107360 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f907ffff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f908019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f907ffff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f908019f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32892/0 (socket says 10.20.193.98:32892) 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f907ffff640 1 -- 10.20.193.98:0/1670262091 learned_addr learned my addr 10.20.193.98:0/1670262091 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.735+0000 7f907ffff640 1 -- 10.20.193.98:0/1670262091 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908019fbe0 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.736+0000 7f907ffff640 1 --2- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f908019f6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f906c0091b0 tx=0x7f906c037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.736+0000 7f907d7fa640 1 -- 10.20.193.98:0/1670262091 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f906c0359a0 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.736+0000 7f907d7fa640 1 -- 10.20.193.98:0/1670262091 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f906c043430 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.736+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908019fe70 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.736+0000 7f907d7fa640 1 -- 10.20.193.98:0/1670262091 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f906c042590 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.736+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90801a2b60 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.736+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9080105c50 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.736+0000 7f907d7fa640 1 -- 10.20.193.98:0/1670262091 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f906c035b40 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.737+0000 7f907d7fa640 1 --2- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f905403dbf0 0x7f90540400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.737+0000 7f907d7fa640 1 -- 10.20.193.98:0/1670262091 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f906c0763d0 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.737+0000 7f907f7fe640 1 --2- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f905403dbf0 0x7f90540400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.737+0000 7f907f7fe640 1 --2- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f905403dbf0 0x7f90540400b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f90700099c0 tx=0x7f9070006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.739+0000 7f907d7fa640 1 -- 10.20.193.98:0/1670262091 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f906c04be10 con 0x7f9080105850 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.828+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) -- 0x7f90800630c0 con 0x7f905403dbf0 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.836+0000 7f907d7fa640 1 -- 10.20.193.98:0/1670262091 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f90800630c0 con 0x7f905403dbf0 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f905403dbf0 msgr2=0x7f90540400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 --2- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f905403dbf0 0x7f90540400b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f90700099c0 tx=0x7f9070006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 msgr2=0x7f908019f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:10.863 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 --2- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f908019f6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f906c0091b0 tx=0x7f906c037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:10.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 shutdown_connections 2026-02-20T02:25:10.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 --2- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f905403dbf0 0x7f90540400b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 --2- 10.20.193.98:0/1670262091 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9080105850 0x7f908019f6a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:10.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 >> 10.20.193.98:0/1670262091 conn(0x7f9080101440 msgr2=0x7f9080195c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:10.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 shutdown_connections 2026-02-20T02:25:10.864 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.838+0000 7f90868f0640 1 -- 10.20.193.98:0/1670262091 wait complete. 2026-02-20T02:25:10.864 INFO:teuthology.orchestra.run.trial098.stdout:Deploying node-exporter service with default placement... 2026-02-20T02:25:11.090 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2026-02-20T02:25:11.091 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.957+0000 7f444cf73640 1 Processor -- start 2026-02-20T02:25:11.091 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.957+0000 7f444cf73640 1 -- start start 2026-02-20T02:25:11.091 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.957+0000 7f444cf73640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f4448107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.091 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.957+0000 7f444cf73640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4448107fd0 con 0x7f4448107600 2026-02-20T02:25:11.091 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.957+0000 7f4446575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f4448107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.091 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.958+0000 7f4446575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f4448107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32896/0 (socket says 10.20.193.98:32896) 2026-02-20T02:25:11.091 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.958+0000 7f4446575640 1 -- 10.20.193.98:0/2301950964 learned_addr learned my addr 10.20.193.98:0/2301950964 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:11.091 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.958+0000 7f4446575640 1 -- 10.20.193.98:0/2301950964 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4448108800 con 0x7f4448107600 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.958+0000 7f4446575640 1 --2- 10.20.193.98:0/2301950964 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f4448107a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f443c009920 tx=0x7f443c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4398a84aa873191 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.958+0000 7f4445573640 1 -- 10.20.193.98:0/2301950964 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f443c03c070 con 0x7f4448107600 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.958+0000 7f4445573640 1 -- 10.20.193.98:0/2301950964 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f443c02fe20 con 0x7f4448107600 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.958+0000 7f4445573640 1 -- 10.20.193.98:0/2301950964 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f443c035340 con 0x7f4448107600 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 -- 10.20.193.98:0/2301950964 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 msgr2=0x7f4448107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 --2- 10.20.193.98:0/2301950964 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f4448107a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f443c009920 tx=0x7f443c02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 -- 10.20.193.98:0/2301950964 shutdown_connections 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 --2- 10.20.193.98:0/2301950964 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f4448107a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 -- 10.20.193.98:0/2301950964 >> 10.20.193.98:0/2301950964 conn(0x7f4448102dd0 msgr2=0x7f44481051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:11.092 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 -- 10.20.193.98:0/2301950964 shutdown_connections 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 -- 10.20.193.98:0/2301950964 wait complete. 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 Processor -- start 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 -- start start 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f444819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f444cf73640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f444810ba30 con 0x7f4448107600 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f4446575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f444819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f4446575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f444819f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32902/0 (socket says 10.20.193.98:32902) 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f4446575640 1 -- 10.20.193.98:0/1113961605 learned_addr learned my addr 10.20.193.98:0/1113961605 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.959+0000 7f4446575640 1 -- 10.20.193.98:0/1113961605 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444819fc90 con 0x7f4448107600 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.960+0000 7f4446575640 1 --2- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f444819f750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f443c0091b0 tx=0x7f443c037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.093 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.960+0000 7f442f7fe640 1 -- 10.20.193.98:0/1113961605 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f443c0359a0 con 0x7f4448107600 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.960+0000 7f442f7fe640 1 -- 10.20.193.98:0/1113961605 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f443c043430 con 0x7f4448107600 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.960+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444819ff20 con 0x7f4448107600 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.960+0000 7f442f7fe640 1 -- 10.20.193.98:0/1113961605 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f443c042590 con 0x7f4448107600 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.960+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44481a2c10 con 0x7f4448107600 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.960+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4448107a80 con 0x7f4448107600 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.960+0000 7f442f7fe640 1 -- 10.20.193.98:0/1113961605 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f443c042840 con 0x7f4448107600 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.961+0000 7f442f7fe640 1 --2- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f442003dbf0 0x7f44200400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.961+0000 7f442f7fe640 1 -- 10.20.193.98:0/1113961605 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f443c076350 con 0x7f4448107600 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.961+0000 7f4445d74640 1 --2- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f442003dbf0 0x7f44200400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.961+0000 7f4445d74640 1 --2- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f442003dbf0 0x7f44200400b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f44300099c0 tx=0x7f4430006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.094 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:10.963+0000 7f442f7fe640 1 -- 10.20.193.98:0/1113961605 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f443c033200 con 0x7f4448107600 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.055+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) -- 0x7f4448103fb0 con 0x7f442003dbf0 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.058+0000 7f442f7fe640 1 -- 10.20.193.98:0/1113961605 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7f4448103fb0 con 0x7f442003dbf0 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f442003dbf0 msgr2=0x7f44200400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 --2- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f442003dbf0 0x7f44200400b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f44300099c0 tx=0x7f4430006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 msgr2=0x7f444819f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 --2- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f444819f750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f443c0091b0 tx=0x7f443c037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 shutdown_connections 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 --2- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f442003dbf0 0x7f44200400b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 --2- 10.20.193.98:0/1113961605 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4448107600 0x7f444819f750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.095 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 >> 10.20.193.98:0/1113961605 conn(0x7f4448102dd0 msgr2=0x7f44481038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:11.096 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 shutdown_connections 2026-02-20T02:25:11.096 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.061+0000 7f444cf73640 1 -- 10.20.193.98:0/1113961605 wait complete. 2026-02-20T02:25:11.096 INFO:teuthology.orchestra.run.trial098.stdout:Deploying alertmanager service with default placement... 2026-02-20T02:25:11.309 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2026-02-20T02:25:11.309 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.186+0000 7fd8b5ee9640 1 Processor -- start 2026-02-20T02:25:11.309 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.187+0000 7fd8b5ee9640 1 -- start start 2026-02-20T02:25:11.309 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.187+0000 7fd8b5ee9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b0109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.310 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.187+0000 7fd8b5ee9640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b010a250 con 0x7fd8b0109880 2026-02-20T02:25:11.310 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.187+0000 7fd8af7fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b0109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.310 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.187+0000 7fd8af7fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b0109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32910/0 (socket says 10.20.193.98:32910) 2026-02-20T02:25:11.310 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.187+0000 7fd8af7fe640 1 -- 10.20.193.98:0/2868527352 learned_addr learned my addr 10.20.193.98:0/2868527352 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:11.310 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.187+0000 7fd8af7fe640 1 -- 10.20.193.98:0/2868527352 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b010aa80 con 0x7fd8b0109880 2026-02-20T02:25:11.310 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.187+0000 7fd8af7fe640 1 --2- 10.20.193.98:0/2868527352 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b0109c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009920 tx=0x7fd89c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88924226525da22 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.310 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8ae7fc640 1 -- 10.20.193.98:0/2868527352 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd89c03c070 con 0x7fd8b0109880 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8ae7fc640 1 -- 10.20.193.98:0/2868527352 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fd89c02fe20 con 0x7fd8b0109880 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8ae7fc640 1 -- 10.20.193.98:0/2868527352 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd89c035340 con 0x7fd8b0109880 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/2868527352 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 msgr2=0x7fd8b0109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 --2- 10.20.193.98:0/2868527352 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b0109c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009920 tx=0x7fd89c02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/2868527352 shutdown_connections 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 --2- 10.20.193.98:0/2868527352 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b0109c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/2868527352 >> 10.20.193.98:0/2868527352 conn(0x7fd8b007ce10 msgr2=0x7fd8b007d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/2868527352 shutdown_connections 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/2868527352 wait complete. 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 Processor -- start 2026-02-20T02:25:11.311 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 -- start start 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8b5ee9640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b010dcb0 con 0x7fd8b0109880 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8af7fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8af7fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b019f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32920/0 (socket says 10.20.193.98:32920) 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.188+0000 7fd8af7fe640 1 -- 10.20.193.98:0/976570307 learned_addr learned my addr 10.20.193.98:0/976570307 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8af7fe640 1 -- 10.20.193.98:0/976570307 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b019fc40 con 0x7fd8b0109880 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8af7fe640 1 --2- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b019f700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0091b0 tx=0x7fd89c037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8acff9640 1 -- 10.20.193.98:0/976570307 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd89c0359a0 con 0x7fd8b0109880 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8acff9640 1 -- 10.20.193.98:0/976570307 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fd89c043430 con 0x7fd8b0109880 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b019fed0 con 0x7fd8b0109880 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8acff9640 1 -- 10.20.193.98:0/976570307 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd89c042590 con 0x7fd8b0109880 2026-02-20T02:25:11.312 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b01a2bc0 con 0x7fd8b0109880 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b0109d00 con 0x7fd8b0109880 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.189+0000 7fd8acff9640 1 -- 10.20.193.98:0/976570307 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7fd89c035b40 con 0x7fd8b0109880 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.190+0000 7fd8acff9640 1 --2- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fd88403dbf0 0x7fd8840400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.190+0000 7fd8acff9640 1 -- 10.20.193.98:0/976570307 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd89c076320 con 0x7fd8b0109880 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.190+0000 7fd8aeffd640 1 --2- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fd88403dbf0 0x7fd8840400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.190+0000 7fd8aeffd640 1 --2- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fd88403dbf0 0x7fd8840400b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00099c0 tx=0x7fd8a0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.192+0000 7fd8acff9640 1 -- 10.20.193.98:0/976570307 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd89c02fdf0 con 0x7fd8b0109880 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.280+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) -- 0x7fd8b01076e0 con 0x7fd88403dbf0 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.283+0000 7fd8acff9640 1 -- 10.20.193.98:0/976570307 <== mgr.14118 v2:10.20.193.98:6800/2682971939 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7fd8b01076e0 con 0x7fd88403dbf0 2026-02-20T02:25:11.313 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fd88403dbf0 msgr2=0x7fd8840400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 --2- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fd88403dbf0 0x7fd8840400b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00099c0 tx=0x7fd8a0006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 msgr2=0x7fd8b019f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 --2- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b019f700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0091b0 tx=0x7fd89c037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 shutdown_connections 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 --2- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fd88403dbf0 0x7fd8840400b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 --2- 10.20.193.98:0/976570307 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd8b0109880 0x7fd8b019f700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 >> 10.20.193.98:0/976570307 conn(0x7fd8b007ce10 msgr2=0x7fd8b0106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 shutdown_connections 2026-02-20T02:25:11.314 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.284+0000 7fd8b5ee9640 1 -- 10.20.193.98:0/976570307 wait complete. 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: Added host trial098 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: Saving service mon spec with placement count:5 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: Saving service mgr spec with placement count:2 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: Saving service crash spec with placement * 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:11.344 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:11 trial098 ceph-mon[38923]: from='mgr.14118 10.20.193.98:0/4129445773' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:11.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.398+0000 7fc915567640 1 Processor -- start 2026-02-20T02:25:11.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.398+0000 7fc915567640 1 -- start start 2026-02-20T02:25:11.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc915567640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc910109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc915567640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc91010a250 con 0x7fc910109880 2026-02-20T02:25:11.597 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc90effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc910109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc90effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc910109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32922/0 (socket says 10.20.193.98:32922) 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc90effd640 1 -- 10.20.193.98:0/3944693243 learned_addr learned my addr 10.20.193.98:0/3944693243 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc90effd640 1 -- 10.20.193.98:0/3944693243 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91010aa80 con 0x7fc910109880 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc90effd640 1 --2- 10.20.193.98:0/3944693243 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc910109c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc904009920 tx=0x7fc90402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68f8af1599ad8d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc90dffb640 1 -- 10.20.193.98:0/3944693243 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc90403c070 con 0x7fc910109880 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc90dffb640 1 -- 10.20.193.98:0/3944693243 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc90402fe20 con 0x7fc910109880 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.399+0000 7fc90dffb640 1 -- 10.20.193.98:0/3944693243 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc904035340 con 0x7fc910109880 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 -- 10.20.193.98:0/3944693243 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 msgr2=0x7fc910109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 --2- 10.20.193.98:0/3944693243 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc910109c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc904009920 tx=0x7fc90402ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 -- 10.20.193.98:0/3944693243 shutdown_connections 2026-02-20T02:25:11.598 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 --2- 10.20.193.98:0/3944693243 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc910109c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 -- 10.20.193.98:0/3944693243 >> 10.20.193.98:0/3944693243 conn(0x7fc91007ce10 msgr2=0x7fc91007d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 -- 10.20.193.98:0/3944693243 shutdown_connections 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 -- 10.20.193.98:0/3944693243 wait complete. 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 Processor -- start 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 -- start start 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc91019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc915567640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc91010dcb0 con 0x7fc910109880 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc90effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc91019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc90effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc91019f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32930/0 (socket says 10.20.193.98:32930) 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc90effd640 1 -- 10.20.193.98:0/3276903190 learned_addr learned my addr 10.20.193.98:0/3276903190 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.400+0000 7fc90effd640 1 -- 10.20.193.98:0/3276903190 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91019fc70 con 0x7fc910109880 2026-02-20T02:25:11.599 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.401+0000 7fc90effd640 1 --2- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc91019f730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9040091b0 tx=0x7fc904037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.401+0000 7fc8effff640 1 -- 10.20.193.98:0/3276903190 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc9040359a0 con 0x7fc910109880 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.401+0000 7fc8effff640 1 -- 10.20.193.98:0/3276903190 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc904043430 con 0x7fc910109880 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.401+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91019ff00 con 0x7fc910109880 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.401+0000 7fc8effff640 1 -- 10.20.193.98:0/3276903190 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc904042590 con 0x7fc910109880 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.401+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9101a2bf0 con 0x7fc910109880 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.401+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc910109d00 con 0x7fc910109880 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.401+0000 7fc8effff640 1 -- 10.20.193.98:0/3276903190 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7fc904035b40 con 0x7fc910109880 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.402+0000 7fc8effff640 1 --2- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fc8e403dbf0 0x7fc8e40400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.402+0000 7fc8effff640 1 -- 10.20.193.98:0/3276903190 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc904076330 con 0x7fc910109880 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.402+0000 7fc90e7fc640 1 --2- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fc8e403dbf0 0x7fc8e40400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.600 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.402+0000 7fc90e7fc640 1 --2- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fc8e403dbf0 0x7fc8e40400b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80099c0 tx=0x7fc8f8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.404+0000 7fc8effff640 1 -- 10.20.193.98:0/3276903190 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc90404be10 con 0x7fc910109880 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.487+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fc9101a32e0 con 0x7fc910109880 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.489+0000 7fc8effff640 1 -- 10.20.193.98:0/3276903190 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fc904076090 con 0x7fc910109880 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fc8e403dbf0 msgr2=0x7fc8e40400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 --2- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fc8e403dbf0 0x7fc8e40400b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80099c0 tx=0x7fc8f8006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 msgr2=0x7fc91019f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 --2- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc91019f730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9040091b0 tx=0x7fc904037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 shutdown_connections 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 --2- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7fc8e403dbf0 0x7fc8e40400b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 --2- 10.20.193.98:0/3276903190 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc910109880 0x7fc91019f730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 >> 10.20.193.98:0/3276903190 conn(0x7fc91007ce10 msgr2=0x7fc910106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:11.601 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 shutdown_connections 2026-02-20T02:25:11.602 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.491+0000 7fc915567640 1 -- 10.20.193.98:0/3276903190 wait complete. 2026-02-20T02:25:11.823 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.691+0000 7f5efcfc3640 1 Processor -- start 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.691+0000 7f5efcfc3640 1 -- start start 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.691+0000 7f5efcfc3640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef8109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.691+0000 7f5efcfc3640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef810a250 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.691+0000 7f5ef6575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef8109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.691+0000 7f5ef6575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef8109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32944/0 (socket says 10.20.193.98:32944) 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.691+0000 7f5ef6575640 1 -- 10.20.193.98:0/1913615620 learned_addr learned my addr 10.20.193.98:0/1913615620 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.691+0000 7f5ef6575640 1 -- 10.20.193.98:0/1913615620 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef810aa80 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5ef6575640 1 --2- 10.20.193.98:0/1913615620 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef8109c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009920 tx=0x7f5eec02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1204025142932c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5ef5573640 1 -- 10.20.193.98:0/1913615620 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5eec03c070 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5ef5573640 1 -- 10.20.193.98:0/1913615620 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f5eec02fe20 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5ef5573640 1 -- 10.20.193.98:0/1913615620 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5eec035340 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1913615620 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 msgr2=0x7f5ef8109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5efcfc3640 1 --2- 10.20.193.98:0/1913615620 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef8109c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009920 tx=0x7f5eec02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1913615620 shutdown_connections 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5efcfc3640 1 --2- 10.20.193.98:0/1913615620 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef8109c80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1913615620 >> 10.20.193.98:0/1913615620 conn(0x7f5ef807cf00 msgr2=0x7f5ef807d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1913615620 shutdown_connections 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.692+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1913615620 wait complete. 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5efcfc3640 1 Processor -- start 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5efcfc3640 1 -- start start 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5efcfc3640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5efcfc3640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef810dcb0 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5ef6575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5ef6575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32946/0 (socket says 10.20.193.98:32946) 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5ef6575640 1 -- 10.20.193.98:0/1661010827 learned_addr learned my addr 10.20.193.98:0/1661010827 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5ef6575640 1 -- 10.20.193.98:0/1661010827 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef819fcb0 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5ef6575640 1 --2- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef819f770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0091b0 tx=0x7f5eec037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5edf7fe640 1 -- 10.20.193.98:0/1661010827 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5eec0359a0 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5edf7fe640 1 -- 10.20.193.98:0/1661010827 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f5eec043430 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef819ff40 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5edf7fe640 1 -- 10.20.193.98:0/1661010827 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5eec042590 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.693+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef81a2c30 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.694+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef8109d00 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.694+0000 7f5edf7fe640 1 -- 10.20.193.98:0/1661010827 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f5eec035b40 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.694+0000 7f5edf7fe640 1 --2- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5ed003dbf0 0x7f5ed00400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.694+0000 7f5edf7fe640 1 -- 10.20.193.98:0/1661010827 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5eec076320 con 0x7f5ef8109880 2026-02-20T02:25:11.824 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.694+0000 7f5ef5d74640 1 --2- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5ed003dbf0 0x7f5ed00400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.694+0000 7f5ef5d74640 1 --2- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5ed003dbf0 0x7f5ed00400b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00099c0 tx=0x7f5ee0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.696+0000 7f5edf7fe640 1 -- 10.20.193.98:0/1661010827 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5eec02fdf0 con 0x7f5ef8109880 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.779+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f5ef81a3400 con 0x7f5ef8109880 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.781+0000 7f5edf7fe640 1 -- 10.20.193.98:0/1661010827 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f5eec0471c0 con 0x7f5ef8109880 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5ed003dbf0 msgr2=0x7f5ed00400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 --2- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5ed003dbf0 0x7f5ed00400b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00099c0 tx=0x7f5ee0006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 msgr2=0x7f5ef819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 --2- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef819f770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0091b0 tx=0x7f5eec037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 shutdown_connections 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 --2- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f5ed003dbf0 0x7f5ed00400b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 --2- 10.20.193.98:0/1661010827 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5ef8109880 0x7f5ef819f770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 >> 10.20.193.98:0/1661010827 conn(0x7f5ef807cf00 msgr2=0x7f5ef8107010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 shutdown_connections 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.782+0000 7f5efcfc3640 1 -- 10.20.193.98:0/1661010827 wait complete. 2026-02-20T02:25:11.825 INFO:teuthology.orchestra.run.trial098.stdout:Enabling the dashboard module... 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: Saving service ceph-exporter spec with placement * 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: Saving service prometheus spec with placement count:1 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: Saving service grafana spec with placement count:1 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: Saving service node-exporter spec with placement * 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: Saving service alertmanager spec with placement count:1 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3276903190' entity='client.admin' 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1661010827' entity='client.admin' 2026-02-20T02:25:12.782 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3329744497' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.915+0000 7ff30a909640 1 Processor -- start 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.915+0000 7ff30a909640 1 -- start start 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.915+0000 7ff30a909640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff304109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.915+0000 7ff30a909640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff30410a250 con 0x7ff304109880 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.915+0000 7ff303fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff304109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.915+0000 7ff303fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff304109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32952/0 (socket says 10.20.193.98:32952) 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.915+0000 7ff303fff640 1 -- 10.20.193.98:0/4129211811 learned_addr learned my addr 10.20.193.98:0/4129211811 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.916+0000 7ff303fff640 1 -- 10.20.193.98:0/4129211811 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30410aa80 con 0x7ff304109880 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.916+0000 7ff303fff640 1 --2- 10.20.193.98:0/4129211811 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff304109c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009920 tx=0x7ff2f002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d1a1276a1139ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.916+0000 7ff302ffd640 1 -- 10.20.193.98:0/4129211811 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2f003c070 con 0x7ff304109880 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.916+0000 7ff302ffd640 1 -- 10.20.193.98:0/4129211811 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff2f002fe20 con 0x7ff304109880 2026-02-20T02:25:12.808 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.916+0000 7ff302ffd640 1 -- 10.20.193.98:0/4129211811 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2f0035340 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.916+0000 7ff30a909640 1 -- 10.20.193.98:0/4129211811 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 msgr2=0x7ff304109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.916+0000 7ff30a909640 1 --2- 10.20.193.98:0/4129211811 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff304109c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009920 tx=0x7ff2f002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 -- 10.20.193.98:0/4129211811 shutdown_connections 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 --2- 10.20.193.98:0/4129211811 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff304109c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 -- 10.20.193.98:0/4129211811 >> 10.20.193.98:0/4129211811 conn(0x7ff30407ce10 msgr2=0x7ff30407d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 -- 10.20.193.98:0/4129211811 shutdown_connections 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 -- 10.20.193.98:0/4129211811 wait complete. 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 Processor -- start 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 -- start start 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff30419f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff30a909640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff30410dcb0 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff303fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff30419f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff303fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff30419f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32956/0 (socket says 10.20.193.98:32956) 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff303fff640 1 -- 10.20.193.98:0/3329744497 learned_addr learned my addr 10.20.193.98:0/3329744497 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff303fff640 1 -- 10.20.193.98:0/3329744497 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30419fc40 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.917+0000 7ff303fff640 1 --2- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff30419f700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00091b0 tx=0x7ff2f0037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff3017fa640 1 -- 10.20.193.98:0/3329744497 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2f00359a0 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff3017fa640 1 -- 10.20.193.98:0/3329744497 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff2f0043430 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30419fed0 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff3017fa640 1 -- 10.20.193.98:0/3329744497 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2f0042590 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3041a2bc0 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff304109d00 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff3017fa640 1 -- 10.20.193.98:0/3329744497 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7ff2f0035b40 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff3017fa640 1 --2- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7ff2d803dbf0 0x7ff2d80400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff3017fa640 1 -- 10.20.193.98:0/3329744497 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff2f0076330 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.918+0000 7ff3037fe640 1 --2- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7ff2d803dbf0 0x7ff2d80400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.919+0000 7ff3037fe640 1 --2- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7ff2d803dbf0 0x7ff2d80400b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40099c0 tx=0x7ff2f4006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:11.921+0000 7ff3017fa640 1 -- 10.20.193.98:0/3329744497 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff2f004be10 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.025+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7ff3041a3320 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.781+0000 7ff3017fa640 1 -- 10.20.193.98:0/3329744497 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7ff2f0076090 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff3017fa640 1 -- 10.20.193.98:0/3329744497 <== mon.0 v2:10.20.193.98:3300/0 8 ==== mgrmap(e 9) ==== 50274+0+0 (secure 0 0 0) 0x7ff2f00435e0 con 0x7ff304109880 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7ff2d803dbf0 msgr2=0x7ff2d80400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 --2- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7ff2d803dbf0 0x7ff2d80400b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40099c0 tx=0x7ff2f4006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 msgr2=0x7ff30419f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 --2- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff30419f700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00091b0 tx=0x7ff2f0037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 shutdown_connections 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 --2- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7ff2d803dbf0 0x7ff2d80400b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 --2- 10.20.193.98:0/3329744497 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff304109880 0x7ff30419f700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 >> 10.20.193.98:0/3329744497 conn(0x7ff30407ce10 msgr2=0x7ff304106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.783+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 shutdown_connections 2026-02-20T02:25:12.809 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.784+0000 7ff30a909640 1 -- 10.20.193.98:0/3329744497 wait complete. 2026-02-20T02:25:13.038 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout { 2026-02-20T02:25:13.039 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-20T02:25:13.039 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T02:25:13.039 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "active_name": "trial098.hiicxh", 2026-02-20T02:25:13.039 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-20T02:25:13.039 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout } 2026-02-20T02:25:13.039 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.901+0000 7f8714844640 1 Processor -- start 2026-02-20T02:25:13.039 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.901+0000 7f8714844640 1 -- start start 2026-02-20T02:25:13.039 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.901+0000 7f8714844640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.901+0000 7f8714844640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f870c10a250 con 0x7f870c109880 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.901+0000 7f87125b9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.901+0000 7f87125b9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:32992/0 (socket says 10.20.193.98:32992) 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.901+0000 7f87125b9640 1 -- 10.20.193.98:0/583768575 learned_addr learned my addr 10.20.193.98:0/583768575 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f87125b9640 1 -- 10.20.193.98:0/583768575 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c10aa80 con 0x7f870c109880 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f87125b9640 1 --2- 10.20.193.98:0/583768575 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c109c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8704009920 tx=0x7f870402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47c46f9e4418aa7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f87115b7640 1 -- 10.20.193.98:0/583768575 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f870403c070 con 0x7f870c109880 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f87115b7640 1 -- 10.20.193.98:0/583768575 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f870402fe20 con 0x7f870c109880 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f87115b7640 1 -- 10.20.193.98:0/583768575 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8704035340 con 0x7f870c109880 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f8714844640 1 -- 10.20.193.98:0/583768575 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 msgr2=0x7f870c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:13.040 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f8714844640 1 --2- 10.20.193.98:0/583768575 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c109c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8704009920 tx=0x7f870402ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f8714844640 1 -- 10.20.193.98:0/583768575 shutdown_connections 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f8714844640 1 --2- 10.20.193.98:0/583768575 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c109c80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f8714844640 1 -- 10.20.193.98:0/583768575 >> 10.20.193.98:0/583768575 conn(0x7f870c07cf00 msgr2=0x7f870c07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f8714844640 1 -- 10.20.193.98:0/583768575 shutdown_connections 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.902+0000 7f8714844640 1 -- 10.20.193.98:0/583768575 wait complete. 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f8714844640 1 Processor -- start 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f8714844640 1 -- start start 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f8714844640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f8714844640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f870c10dcb0 con 0x7f870c109880 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f87125b9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f87125b9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c19f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33002/0 (socket says 10.20.193.98:33002) 2026-02-20T02:25:13.041 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f87125b9640 1 -- 10.20.193.98:0/3578950061 learned_addr learned my addr 10.20.193.98:0/3578950061 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f87125b9640 1 -- 10.20.193.98:0/3578950061 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c19fcb0 con 0x7f870c109880 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f87125b9640 1 --2- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c19f770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8704002410 tx=0x7f87040379e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f86f77fe640 1 -- 10.20.193.98:0/3578950061 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f87040358d0 con 0x7f870c109880 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f86f77fe640 1 -- 10.20.193.98:0/3578950061 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8704043430 con 0x7f870c109880 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870c19ff40 con 0x7f870c109880 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f86f77fe640 1 -- 10.20.193.98:0/3578950061 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f87040423e0 con 0x7f870c109880 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.903+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f870c1a2c30 con 0x7f870c109880 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.904+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870c109d00 con 0x7f870c109880 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.904+0000 7f86f77fe640 1 -- 10.20.193.98:0/3578950061 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 9) ==== 50274+0+0 (secure 0 0 0) 0x7f8704043990 con 0x7f870c109880 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.904+0000 7f86f77fe640 1 --2- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f86e803dc40 0x7f86e8040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.904+0000 7f8711db8640 1 -- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f86e803dc40 msgr2=0x7f86e8040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/2682971939 2026-02-20T02:25:13.042 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.904+0000 7f86f77fe640 1 -- 10.20.193.98:0/3578950061 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8704076360 con 0x7f870c109880 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.904+0000 7f8711db8640 1 --2- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f86e803dc40 0x7f86e8040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:12.907+0000 7f86f77fe640 1 -- 10.20.193.98:0/3578950061 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8704033200 con 0x7f870c109880 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.011+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f870c1a3320 con 0x7f870c109880 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.011+0000 7f86f77fe640 1 -- 10.20.193.98:0/3578950061 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+102 (secure 0 0 0) 0x7f87040760c0 con 0x7f870c109880 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f86e803dc40 msgr2=0x7f86e8040100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 --2- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f86e803dc40 0x7f86e8040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 msgr2=0x7f870c19f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 --2- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c19f770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8704002410 tx=0x7f87040379e0 comp rx=0 tx=0).stop 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 shutdown_connections 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 --2- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f86e803dc40 0x7f86e8040100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 --2- 10.20.193.98:0/3578950061 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f870c109880 0x7f870c19f770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:13.043 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 >> 10.20.193.98:0/3578950061 conn(0x7f870c07cf00 msgr2=0x7f870c107010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:13.044 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 shutdown_connections 2026-02-20T02:25:13.044 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.013+0000 7f8714844640 1 -- 10.20.193.98:0/3578950061 wait complete. 2026-02-20T02:25:13.044 INFO:teuthology.orchestra.run.trial098.stdout:Waiting for the mgr to restart... 2026-02-20T02:25:13.044 INFO:teuthology.orchestra.run.trial098.stdout:Waiting for mgr epoch 9... 2026-02-20T02:25:13.892 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:13 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3329744497' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-20T02:25:13.892 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:13 trial098 ceph-mon[38923]: mgrmap e9: trial098.hiicxh(active, since 6s) 2026-02-20T02:25:13.892 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:13 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3578950061' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-20T02:25:15.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: Active manager daemon trial098.hiicxh restarted 2026-02-20T02:25:15.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: Activating manager daemon trial098.hiicxh 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: osdmap e3: 0 total, 0 up, 0 in 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: mgrmap e10: trial098.hiicxh(active, starting, since 0.00259681s) 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr metadata", "who": "trial098.hiicxh", "id": "trial098.hiicxh"}]: dispatch 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: Manager daemon trial098.hiicxh is now available 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:15.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial098.hiicxh/mirror_snapshot_schedule"}]: dispatch 2026-02-20T02:25:15.816 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:15 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial098.hiicxh/trash_purge_schedule"}]: dispatch 2026-02-20T02:25:16.514 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout { 2026-02-20T02:25:16.514 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-20T02:25:16.514 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-20T02:25:16.514 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout } 2026-02-20T02:25:16.514 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.131+0000 7f87a31de640 1 Processor -- start 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.131+0000 7f87a31de640 1 -- start start 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.131+0000 7f87a31de640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.131+0000 7f87a31de640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f879c10a250 con 0x7f879c109880 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.131+0000 7f87a0f53640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.131+0000 7f87a0f53640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33008/0 (socket says 10.20.193.98:33008) 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.131+0000 7f87a0f53640 1 -- 10.20.193.98:0/2027348931 learned_addr learned my addr 10.20.193.98:0/2027348931 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.131+0000 7f87a0f53640 1 -- 10.20.193.98:0/2027348931 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c10aa80 con 0x7f879c109880 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a0f53640 1 --2- 10.20.193.98:0/2027348931 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c109c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f878c009920 tx=0x7f878c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2286150c9a4f3d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87937fe640 1 -- 10.20.193.98:0/2027348931 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f878c03c070 con 0x7f879c109880 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87937fe640 1 -- 10.20.193.98:0/2027348931 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f878c02fe20 con 0x7f879c109880 2026-02-20T02:25:16.515 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87937fe640 1 -- 10.20.193.98:0/2027348931 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f878c035340 con 0x7f879c109880 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a31de640 1 -- 10.20.193.98:0/2027348931 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 msgr2=0x7f879c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a31de640 1 --2- 10.20.193.98:0/2027348931 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c109c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f878c009920 tx=0x7f878c02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a31de640 1 -- 10.20.193.98:0/2027348931 shutdown_connections 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a31de640 1 --2- 10.20.193.98:0/2027348931 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c109c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a31de640 1 -- 10.20.193.98:0/2027348931 >> 10.20.193.98:0/2027348931 conn(0x7f879c07cf00 msgr2=0x7f879c07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a31de640 1 -- 10.20.193.98:0/2027348931 shutdown_connections 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a31de640 1 -- 10.20.193.98:0/2027348931 wait complete. 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.132+0000 7f87a31de640 1 Processor -- start 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a31de640 1 -- start start 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a31de640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a31de640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f879c10dcb0 con 0x7f879c109880 2026-02-20T02:25:16.516 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a0f53640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a0f53640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c19f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33020/0 (socket says 10.20.193.98:33020) 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a0f53640 1 -- 10.20.193.98:0/2025496317 learned_addr learned my addr 10.20.193.98:0/2025496317 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a0f53640 1 -- 10.20.193.98:0/2025496317 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c19fcb0 con 0x7f879c109880 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a0f53640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c19f770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f878c002410 tx=0x7f878c0379e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f878c0358d0 con 0x7f879c109880 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f878c043430 con 0x7f879c109880 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c19ff40 con 0x7f879c109880 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f878c0423e0 con 0x7f879c109880 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.133+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c1a2c30 con 0x7f879c109880 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.134+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 9) ==== 50274+0+0 (secure 0 0 0) 0x7f878c043990 con 0x7f879c109880 2026-02-20T02:25:16.517 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.134+0000 7f8791ffb640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 0x7f8778040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:16.518 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.134+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 --> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8778040810 con 0x7f877803dc40 2026-02-20T02:25:16.518 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.134+0000 7f8793fff640 1 -- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 msgr2=0x7f8778040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/2682971939 2026-02-20T02:25:16.518 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.134+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f878c076360 con 0x7f879c109880 2026-02-20T02:25:16.518 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.134+0000 7f8793fff640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 0x7f8778040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T02:25:16.518 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.335+0000 7f8793fff640 1 -- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 msgr2=0x7f8778040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/2682971939 2026-02-20T02:25:16.518 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.335+0000 7f8793fff640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 0x7f8778040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-20T02:25:16.518 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.736+0000 7f8793fff640 1 -- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 msgr2=0x7f8778040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/2682971939 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:13.736+0000 7f8793fff640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 0x7f8778040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:14.537+0000 7f8793fff640 1 -- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 msgr2=0x7f8778040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/2682971939 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:14.537+0000 7f8793fff640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 0x7f8778040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:15.464+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mgrmap(e 10) ==== 50041+0+0 (secure 0 0 0) 0x7f878c075160 con 0x7f879c109880 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:15.464+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 msgr2=0x7f8778040100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:15.464+0000 7f8791ffb640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 0x7f8778040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.465+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7f878c0435e0 con 0x7f879c109880 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.465+0000 7f8791ffb640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f8778041720 0x7f8778043b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.465+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 --> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8778040810 con 0x7f8778041720 2026-02-20T02:25:16.519 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.465+0000 7f8793fff640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f8778041720 0x7f8778043b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.466+0000 7f8793fff640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f8778041720 0x7f8778043b10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8784003a80 tx=0x7f87840092b0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.466+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mgr.14162 v2:10.20.193.98:6800/892283834 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f8778040810 con 0x7f8778041720 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.469+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 --> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f8764002670 con 0x7f8778041720 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f8791ffb640 1 -- 10.20.193.98:0/2025496317 <== mgr.14162 v2:10.20.193.98:6800/892283834 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f8764002670 con 0x7f8778041720 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f8778041720 msgr2=0x7f8778043b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f8778041720 0x7f8778043b10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8784003a80 tx=0x7f87840092b0 comp rx=0 tx=0).stop 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 msgr2=0x7f879c19f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c19f770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f878c002410 tx=0x7f878c0379e0 comp rx=0 tx=0).stop 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 shutdown_connections 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f8778041720 0x7f8778043b10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:6800/2682971939,v1:10.20.193.98:6801/2682971939] conn(0x7f877803dc40 0x7f8778040100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:16.520 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 --2- 10.20.193.98:0/2025496317 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f879c109880 0x7f879c19f770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:16.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 >> 10.20.193.98:0/2025496317 conn(0x7f879c07cf00 msgr2=0x7f879c107040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:16.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 shutdown_connections 2026-02-20T02:25:16.521 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.470+0000 7f87a31de640 1 -- 10.20.193.98:0/2025496317 wait complete. 2026-02-20T02:25:16.521 INFO:teuthology.orchestra.run.trial098.stdout:mgr epoch 9 is available 2026-02-20T02:25:16.521 INFO:teuthology.orchestra.run.trial098.stdout:Generating a dashboard self-signed certificate... 2026-02-20T02:25:17.039 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:17.040 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:17.040 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:16] ENGINE Bus STARTING 2026-02-20T02:25:17.040 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-20T02:25:17.040 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: mgrmap e11: trial098.hiicxh(active, since 1.00435s) 2026-02-20T02:25:17.040 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-20T02:25:17.040 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:16] ENGINE Serving on https://10.20.193.98:7150 2026-02-20T02:25:17.040 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:16] ENGINE Client ('10.20.193.98', 34732) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T02:25:17.041 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:16] ENGINE Serving on http://10.20.193.98:8765 2026-02-20T02:25:17.041 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:16] ENGINE Bus STARTED 2026-02-20T02:25:17.041 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:17.041 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:17.041 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:16 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:17.175 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-20T02:25:17.176 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.690+0000 7f23939bf640 1 Processor -- start 2026-02-20T02:25:17.176 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.690+0000 7f23939bf640 1 -- start start 2026-02-20T02:25:17.176 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f23939bf640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.176 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f23939bf640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f238c10a250 con 0x7f238c109880 2026-02-20T02:25:17.177 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f2391734640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.177 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f2391734640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33080/0 (socket says 10.20.193.98:33080) 2026-02-20T02:25:17.177 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f2391734640 1 -- 10.20.193.98:0/1502503533 learned_addr learned my addr 10.20.193.98:0/1502503533 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:17.177 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f2391734640 1 -- 10.20.193.98:0/1502503533 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c10aa80 con 0x7f238c109880 2026-02-20T02:25:17.177 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f2391734640 1 --2- 10.20.193.98:0/1502503533 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c109c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f237c009920 tx=0x7f237c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb176236ec1145e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.178 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f237bfff640 1 -- 10.20.193.98:0/1502503533 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f237c03c070 con 0x7f238c109880 2026-02-20T02:25:17.178 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f237bfff640 1 -- 10.20.193.98:0/1502503533 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f237c02fe20 con 0x7f238c109880 2026-02-20T02:25:17.178 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.691+0000 7f237bfff640 1 -- 10.20.193.98:0/1502503533 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f237c035340 con 0x7f238c109880 2026-02-20T02:25:17.178 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 -- 10.20.193.98:0/1502503533 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 msgr2=0x7f238c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.178 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 --2- 10.20.193.98:0/1502503533 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c109c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f237c009920 tx=0x7f237c02ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:17.178 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 -- 10.20.193.98:0/1502503533 shutdown_connections 2026-02-20T02:25:17.179 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 --2- 10.20.193.98:0/1502503533 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c109c80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.179 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 -- 10.20.193.98:0/1502503533 >> 10.20.193.98:0/1502503533 conn(0x7f238c07ce10 msgr2=0x7f238c07d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:17.179 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 -- 10.20.193.98:0/1502503533 shutdown_connections 2026-02-20T02:25:17.179 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 -- 10.20.193.98:0/1502503533 wait complete. 2026-02-20T02:25:17.179 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 Processor -- start 2026-02-20T02:25:17.179 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 -- start start 2026-02-20T02:25:17.180 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.180 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f23939bf640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f238c10dcb0 con 0x7f238c109880 2026-02-20T02:25:17.180 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f2391734640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.180 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f2391734640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c19f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33094/0 (socket says 10.20.193.98:33094) 2026-02-20T02:25:17.180 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.692+0000 7f2391734640 1 -- 10.20.193.98:0/3378348760 learned_addr learned my addr 10.20.193.98:0/3378348760 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:17.180 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f2391734640 1 -- 10.20.193.98:0/3378348760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c19fc40 con 0x7f238c109880 2026-02-20T02:25:17.181 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f2391734640 1 --2- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c19f700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f237c0091b0 tx=0x7f237c037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.181 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f237a7fc640 1 -- 10.20.193.98:0/3378348760 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f237c0359a0 con 0x7f238c109880 2026-02-20T02:25:17.181 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c19fed0 con 0x7f238c109880 2026-02-20T02:25:17.181 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f237a7fc640 1 -- 10.20.193.98:0/3378348760 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f237c043430 con 0x7f238c109880 2026-02-20T02:25:17.181 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f237a7fc640 1 -- 10.20.193.98:0/3378348760 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f237c042590 con 0x7f238c109880 2026-02-20T02:25:17.181 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c1a2bc0 con 0x7f238c109880 2026-02-20T02:25:17.182 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c109d00 con 0x7f238c109880 2026-02-20T02:25:17.182 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f237a7fc640 1 -- 10.20.193.98:0/3378348760 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7f237c035b40 con 0x7f238c109880 2026-02-20T02:25:17.182 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.693+0000 7f237a7fc640 1 --2- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f236803dad0 0x7f236803ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.182 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.694+0000 7f237a7fc640 1 -- 10.20.193.98:0/3378348760 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f237c076600 con 0x7f238c109880 2026-02-20T02:25:17.182 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.694+0000 7f2390f33640 1 --2- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f236803dad0 0x7f236803ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.182 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.694+0000 7f2390f33640 1 --2- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f236803dad0 0x7f236803ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f23800099c0 tx=0x7f2380006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.183 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.696+0000 7f237a7fc640 1 -- 10.20.193.98:0/3378348760 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f237c04bde0 con 0x7f238c109880 2026-02-20T02:25:17.183 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.781+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 --> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f238c1076e0 con 0x7f236803dad0 2026-02-20T02:25:17.183 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.827+0000 7f237a7fc640 1 -- 10.20.193.98:0/3378348760 <== mgr.14162 v2:10.20.193.98:6800/892283834 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f238c1076e0 con 0x7f236803dad0 2026-02-20T02:25:17.183 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f236803dad0 msgr2=0x7f236803ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.183 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 --2- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f236803dad0 0x7f236803ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f23800099c0 tx=0x7f2380006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.183 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 msgr2=0x7f238c19f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.184 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 --2- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c19f700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f237c0091b0 tx=0x7f237c037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:17.184 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 shutdown_connections 2026-02-20T02:25:17.184 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 --2- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f236803dad0 0x7f236803ff90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.184 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 --2- 10.20.193.98:0/3378348760 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f238c109880 0x7f238c19f700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.184 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 >> 10.20.193.98:0/3378348760 conn(0x7f238c07ce10 msgr2=0x7f238c106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:17.184 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 shutdown_connections 2026-02-20T02:25:17.184 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:16.829+0000 7f23939bf640 1 -- 10.20.193.98:0/3378348760 wait complete. 2026-02-20T02:25:17.184 INFO:teuthology.orchestra.run.trial098.stdout:Creating initial admin user... 2026-02-20T02:25:17.712 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VWABnIFYyJvjuCdiRqofyu6tX8Q.kDgvqx413R86esrqdv0kz2HCW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771554317, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-20T02:25:17.712 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.452+0000 7efc47b9c640 1 Processor -- start 2026-02-20T02:25:17.712 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.453+0000 7efc47b9c640 1 -- start start 2026-02-20T02:25:17.712 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.453+0000 7efc47b9c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc40107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.712 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.453+0000 7efc47b9c640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc40107fd0 con 0x7efc40107600 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.453+0000 7efc45911640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc40107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.453+0000 7efc45911640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc40107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33110/0 (socket says 10.20.193.98:33110) 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.453+0000 7efc45911640 1 -- 10.20.193.98:0/2342751507 learned_addr learned my addr 10.20.193.98:0/2342751507 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.453+0000 7efc45911640 1 -- 10.20.193.98:0/2342751507 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc40108800 con 0x7efc40107600 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc45911640 1 --2- 10.20.193.98:0/2342751507 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc40107a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc30009920 tx=0x7efc3002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d048aaefe47d9f83 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc4490f640 1 -- 10.20.193.98:0/2342751507 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7efc3003c070 con 0x7efc40107600 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc4490f640 1 -- 10.20.193.98:0/2342751507 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7efc3002fe20 con 0x7efc40107600 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc4490f640 1 -- 10.20.193.98:0/2342751507 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7efc30035340 con 0x7efc40107600 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 -- 10.20.193.98:0/2342751507 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 msgr2=0x7efc40107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 --2- 10.20.193.98:0/2342751507 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc40107a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc30009920 tx=0x7efc3002ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:17.713 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 -- 10.20.193.98:0/2342751507 shutdown_connections 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 --2- 10.20.193.98:0/2342751507 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc40107a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 -- 10.20.193.98:0/2342751507 >> 10.20.193.98:0/2342751507 conn(0x7efc40102dd0 msgr2=0x7efc401051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 -- 10.20.193.98:0/2342751507 shutdown_connections 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 -- 10.20.193.98:0/2342751507 wait complete. 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 Processor -- start 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 -- start start 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc4019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.454+0000 7efc47b9c640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc4010ba30 con 0x7efc40107600 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc45911640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc4019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc45911640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc4019f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33112/0 (socket says 10.20.193.98:33112) 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc45911640 1 -- 10.20.193.98:0/4252871004 learned_addr learned my addr 10.20.193.98:0/4252871004 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:17.714 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc45911640 1 -- 10.20.193.98:0/4252871004 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4019fc50 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc45911640 1 --2- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc4019f710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efc300091b0 tx=0x7efc30037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc2effd640 1 -- 10.20.193.98:0/4252871004 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7efc300359a0 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc2effd640 1 -- 10.20.193.98:0/4252871004 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7efc30043430 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4019fee0 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc2effd640 1 -- 10.20.193.98:0/4252871004 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7efc30042590 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc401a2bd0 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc40107a80 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.455+0000 7efc2effd640 1 -- 10.20.193.98:0/4252871004 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7efc30035b40 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.456+0000 7efc2effd640 1 --2- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc1c03db20 0x7efc1c03ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.456+0000 7efc2effd640 1 -- 10.20.193.98:0/4252871004 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efc30076650 con 0x7efc40107600 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.456+0000 7efc45110640 1 --2- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc1c03db20 0x7efc1c03ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.715 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.456+0000 7efc45110640 1 --2- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc1c03db20 0x7efc1c03ffe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efc340099c0 tx=0x7efc34006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.458+0000 7efc2effd640 1 -- 10.20.193.98:0/4252871004 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efc3004be10 con 0x7efc40107600 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.546+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 --> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7efc40103fc0 con 0x7efc1c03db20 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.687+0000 7efc2effd640 1 -- 10.20.193.98:0/4252871004 <== mgr.14162 v2:10.20.193.98:6800/892283834 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7efc40103fc0 con 0x7efc1c03db20 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc1c03db20 msgr2=0x7efc1c03ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 --2- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc1c03db20 0x7efc1c03ffe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efc340099c0 tx=0x7efc34006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 msgr2=0x7efc4019f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 --2- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc4019f710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efc300091b0 tx=0x7efc30037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 shutdown_connections 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 --2- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc1c03db20 0x7efc1c03ffe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 --2- 10.20.193.98:0/4252871004 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc40107600 0x7efc4019f710 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 >> 10.20.193.98:0/4252871004 conn(0x7efc40102dd0 msgr2=0x7efc401038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:17.716 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 shutdown_connections 2026-02-20T02:25:17.717 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.688+0000 7efc47b9c640 1 -- 10.20.193.98:0/4252871004 wait complete. 2026-02-20T02:25:17.717 INFO:teuthology.orchestra.run.trial098.stdout:Fetching dashboard port number... 2026-02-20T02:25:17.916 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stdout 8443 2026-02-20T02:25:17.916 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.801+0000 7f9dee8e9640 1 Processor -- start 2026-02-20T02:25:17.916 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.801+0000 7f9dee8e9640 1 -- start start 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.801+0000 7f9dee8e9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de8109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.801+0000 7f9dee8e9640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9de810a250 con 0x7f9de8109880 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.801+0000 7f9de7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de8109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.801+0000 7f9de7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de8109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33118/0 (socket says 10.20.193.98:33118) 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.801+0000 7f9de7fff640 1 -- 10.20.193.98:0/1265532840 learned_addr learned my addr 10.20.193.98:0/1265532840 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.801+0000 7f9de7fff640 1 -- 10.20.193.98:0/1265532840 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de810aa80 con 0x7f9de8109880 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9de7fff640 1 --2- 10.20.193.98:0/1265532840 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de8109c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009920 tx=0x7f9dd402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e804979f6b11964 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9de6ffd640 1 -- 10.20.193.98:0/1265532840 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9dd403c070 con 0x7f9de8109880 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9de6ffd640 1 -- 10.20.193.98:0/1265532840 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9dd402fe20 con 0x7f9de8109880 2026-02-20T02:25:17.917 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9de6ffd640 1 -- 10.20.193.98:0/1265532840 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9dd4035340 con 0x7f9de8109880 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1265532840 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 msgr2=0x7f9de8109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9dee8e9640 1 --2- 10.20.193.98:0/1265532840 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de8109c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009920 tx=0x7f9dd402ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1265532840 shutdown_connections 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9dee8e9640 1 --2- 10.20.193.98:0/1265532840 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de8109c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1265532840 >> 10.20.193.98:0/1265532840 conn(0x7f9de807cf00 msgr2=0x7f9de807d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1265532840 shutdown_connections 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.802+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1265532840 wait complete. 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9dee8e9640 1 Processor -- start 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9dee8e9640 1 -- start start 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9dee8e9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.918 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9dee8e9640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9de810dcb0 con 0x7f9de8109880 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9de7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9de7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33124/0 (socket says 10.20.193.98:33124) 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9de7fff640 1 -- 10.20.193.98:0/1585102623 learned_addr learned my addr 10.20.193.98:0/1585102623 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9de7fff640 1 -- 10.20.193.98:0/1585102623 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de819fcb0 con 0x7f9de8109880 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9de7fff640 1 --2- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de819f770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40091b0 tx=0x7f9dd4037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9de57fa640 1 -- 10.20.193.98:0/1585102623 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9dd40359a0 con 0x7f9de8109880 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9de57fa640 1 -- 10.20.193.98:0/1585102623 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9dd4043430 con 0x7f9de8109880 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9de57fa640 1 -- 10.20.193.98:0/1585102623 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9dd4042590 con 0x7f9de8109880 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de819ff40 con 0x7f9de8109880 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.803+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de81a2c30 con 0x7f9de8109880 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.804+0000 7f9de57fa640 1 -- 10.20.193.98:0/1585102623 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7f9dd4042840 con 0x7f9de8109880 2026-02-20T02:25:17.919 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.804+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de8109d00 con 0x7f9de8109880 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.804+0000 7f9de57fa640 1 --2- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9dbc03db20 0x7f9dbc03ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.804+0000 7f9de57fa640 1 -- 10.20.193.98:0/1585102623 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9dd40766f0 con 0x7f9de8109880 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.804+0000 7f9de77fe640 1 --2- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9dbc03db20 0x7f9dbc03ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.804+0000 7f9de77fe640 1 --2- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9dbc03db20 0x7f9dbc03ffe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80099c0 tx=0x7f9dd8006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.806+0000 7f9de57fa640 1 -- 10.20.193.98:0/1585102623 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9dd4035d20 con 0x7f9de8109880 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.892+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f9de81a3390 con 0x7f9de8109880 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.892+0000 7f9de57fa640 1 -- 10.20.193.98:0/1585102623 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f9dd4042b60 con 0x7f9de8109880 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9dbc03db20 msgr2=0x7f9dbc03ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 --2- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9dbc03db20 0x7f9dbc03ffe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80099c0 tx=0x7f9dd8006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 msgr2=0x7f9de819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:17.920 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 --2- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de819f770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40091b0 tx=0x7f9dd4037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:17.921 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 shutdown_connections 2026-02-20T02:25:17.921 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 --2- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9dbc03db20 0x7f9dbc03ffe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.921 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 --2- 10.20.193.98:0/1585102623 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8109880 0x7f9de819f770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:17.921 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 >> 10.20.193.98:0/1585102623 conn(0x7f9de807cf00 msgr2=0x7f9de8107010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:17.921 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 shutdown_connections 2026-02-20T02:25:17.921 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:17.893+0000 7f9dee8e9640 1 -- 10.20.193.98:0/1585102623 wait complete. 2026-02-20T02:25:17.922 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T02:25:17.922 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout disabled 2026-02-20T02:25:17.927 INFO:teuthology.orchestra.run.trial098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T02:25:17.927 INFO:teuthology.orchestra.run.trial098.stdout:systemctl: stdout inactive 2026-02-20T02:25:17.928 INFO:teuthology.orchestra.run.trial098.stdout:firewalld.service is not enabled 2026-02-20T02:25:17.928 INFO:teuthology.orchestra.run.trial098.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-20T02:25:17.928 INFO:teuthology.orchestra.run.trial098.stdout:Ceph Dashboard is now available at: 2026-02-20T02:25:17.928 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:17.929 INFO:teuthology.orchestra.run.trial098.stdout: URL: https://trial098:8443/ 2026-02-20T02:25:17.929 INFO:teuthology.orchestra.run.trial098.stdout: User: admin 2026-02-20T02:25:17.929 INFO:teuthology.orchestra.run.trial098.stdout: Password: 4cmqtuej67 2026-02-20T02:25:17.929 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:17.929 INFO:teuthology.orchestra.run.trial098.stdout:Saving cluster configuration to /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config directory 2026-02-20T02:25:18.187 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.022+0000 7fa8ee0b2640 1 Processor -- start 2026-02-20T02:25:18.187 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.022+0000 7fa8ee0b2640 1 -- start start 2026-02-20T02:25:18.188 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.023+0000 7fa8ee0b2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e8108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:18.188 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.023+0000 7fa8ee0b2640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e807b760 con 0x7fa8e8105e50 2026-02-20T02:25:18.188 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.023+0000 7fa8e77fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e8108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:18.188 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.023+0000 7fa8e77fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e8108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33134/0 (socket says 10.20.193.98:33134) 2026-02-20T02:25:18.188 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.023+0000 7fa8e77fe640 1 -- 10.20.193.98:0/1354703388 learned_addr learned my addr 10.20.193.98:0/1354703388 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:18.188 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.023+0000 7fa8e77fe640 1 -- 10.20.193.98:0/1354703388 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e81087a0 con 0x7fa8e8105e50 2026-02-20T02:25:18.188 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.023+0000 7fa8e77fe640 1 --2- 10.20.193.98:0/1354703388 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e8108260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009920 tx=0x7fa8d402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436298d2eeb53010 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8e67fc640 1 -- 10.20.193.98:0/1354703388 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa8d403c070 con 0x7fa8e8105e50 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8e67fc640 1 -- 10.20.193.98:0/1354703388 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa8d402fe20 con 0x7fa8e8105e50 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8e67fc640 1 -- 10.20.193.98:0/1354703388 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa8d4035340 con 0x7fa8e8105e50 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/1354703388 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 msgr2=0x7fa8e8108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 --2- 10.20.193.98:0/1354703388 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e8108260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009920 tx=0x7fa8d402ef20 comp rx=0 tx=0).stop 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/1354703388 shutdown_connections 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 --2- 10.20.193.98:0/1354703388 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e8108260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/1354703388 >> 10.20.193.98:0/1354703388 conn(0x7fa8e8101ce0 msgr2=0x7fa8e8104100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/1354703388 shutdown_connections 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/1354703388 wait complete. 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 Processor -- start 2026-02-20T02:25:18.189 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 -- start start 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e81a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.024+0000 7fa8ee0b2640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8109770 con 0x7fa8e8105e50 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e77fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e81a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e77fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e81a3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:33150/0 (socket says 10.20.193.98:33150) 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e77fe640 1 -- 10.20.193.98:0/3529629419 learned_addr learned my addr 10.20.193.98:0/3529629419 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e77fe640 1 -- 10.20.193.98:0/3529629419 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e81a4150 con 0x7fa8e8105e50 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e77fe640 1 --2- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e81a3c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40091b0 tx=0x7fa8d4037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e4ff9640 1 -- 10.20.193.98:0/3529629419 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa8d40359a0 con 0x7fa8e8105e50 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e4ff9640 1 -- 10.20.193.98:0/3529629419 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa8d4043430 con 0x7fa8e8105e50 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e4ff9640 1 -- 10.20.193.98:0/3529629419 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa8d4042590 con 0x7fa8e8105e50 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e81a43e0 con 0x7fa8e8105e50 2026-02-20T02:25:18.190 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e81a70d0 con 0x7fa8e8105e50 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e8106250 con 0x7fa8e8105e50 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.025+0000 7fa8e4ff9640 1 -- 10.20.193.98:0/3529629419 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7fa8d4035b40 con 0x7fa8e8105e50 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.026+0000 7fa8e4ff9640 1 --2- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa8bc03dc40 0x7fa8bc040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.026+0000 7fa8e4ff9640 1 -- 10.20.193.98:0/3529629419 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa8d4076840 con 0x7fa8e8105e50 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.026+0000 7fa8e6ffd640 1 --2- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa8bc03dc40 0x7fa8bc040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.026+0000 7fa8e6ffd640 1 --2- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa8bc03dc40 0x7fa8bc040100 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80099c0 tx=0x7fa8d8006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.028+0000 7fa8e4ff9640 1 -- 10.20.193.98:0/3529629419 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa8d404be10 con 0x7fa8e8105e50 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.156+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa8e819d360 con 0x7fa8e8105e50 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8e4ff9640 1 -- 10.20.193.98:0/3529629419 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) ==== 153+0+0 (secure 0 0 0) 0x7fa8d40435e0 con 0x7fa8e8105e50 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa8bc03dc40 msgr2=0x7fa8bc040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:18.191 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 --2- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa8bc03dc40 0x7fa8bc040100 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80099c0 tx=0x7fa8d8006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 msgr2=0x7fa8e81a3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 --2- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e81a3c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40091b0 tx=0x7fa8d4037a50 comp rx=0 tx=0).stop 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 shutdown_connections 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 --2- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa8bc03dc40 0x7fa8bc040100 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 --2- 10.20.193.98:0/3529629419 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8e8105e50 0x7fa8e81a3c10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 >> 10.20.193.98:0/3529629419 conn(0x7fa8e8101ce0 msgr2=0x7fa8e810be40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 shutdown_connections 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:/usr/bin/ceph: stderr 2026-02-20T02:25:18.158+0000 7fa8ee0b2640 1 -- 10.20.193.98:0/3529629419 wait complete. 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:18.192 INFO:teuthology.orchestra.run.trial098.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout:Or, if you are only running a single cluster on this host: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: ceph telemetry on 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout:For more information see: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:18.193 INFO:teuthology.orchestra.run.trial098.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-20T02:25:18.194 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:18.194 INFO:teuthology.orchestra.run.trial098.stdout:Bootstrap complete. 2026-02-20T02:25:18.209 INFO:tasks.cephadm:Fetching config... 2026-02-20T02:25:18.209 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:25:18.209 DEBUG:teuthology.orchestra.run.trial098:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-20T02:25:18.224 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-20T02:25:18.224 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:25:18.224 DEBUG:teuthology.orchestra.run.trial098:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-20T02:25:18.281 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-20T02:25:18.282 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:25:18.282 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/keyring of=/dev/stdout 2026-02-20T02:25:18.345 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-20T02:25:18.346 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:25:18.346 DEBUG:teuthology.orchestra.run.trial098:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-20T02:25:18.403 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-20T02:25:18.403 DEBUG:teuthology.orchestra.run.trial098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIByUJXqxozbPbtthyfGmD4mk8CIC0C1WjY6CRKo9eU+M ceph-5138774d-0e03-11f1-8edf-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-20T02:25:18.477 INFO:teuthology.orchestra.run.trial098.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIByUJXqxozbPbtthyfGmD4mk8CIC0C1WjY6CRKo9eU+M ceph-5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:25:18.487 DEBUG:teuthology.orchestra.run.trial106:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIByUJXqxozbPbtthyfGmD4mk8CIC0C1WjY6CRKo9eU+M ceph-5138774d-0e03-11f1-8edf-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-20T02:25:18.523 INFO:teuthology.orchestra.run.trial106.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIByUJXqxozbPbtthyfGmD4mk8CIC0C1WjY6CRKo9eU+M ceph-5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:25:18.534 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-20T02:25:18.683 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:18.733 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:18 trial098 ceph-mon[38923]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:18.733 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:18 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:18.733 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:18 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1585102623' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-20T02:25:18.733 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:18 trial098 ceph-mon[38923]: mgrmap e12: trial098.hiicxh(active, since 2s) 2026-02-20T02:25:18.733 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:18 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3529629419' entity='client.admin' 2026-02-20T02:25:18.799 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 -- 10.20.193.98:0/991282690 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 msgr2=0x7f5b28105290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:18.799 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 --2- 10.20.193.98:0/991282690 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 0x7f5b28105290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b180099b0 tx=0x7f5b1802f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 -- 10.20.193.98:0/991282690 shutdown_connections 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 --2- 10.20.193.98:0/991282690 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 0x7f5b28105290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 -- 10.20.193.98:0/991282690 >> 10.20.193.98:0/991282690 conn(0x7f5b280fc9a0 msgr2=0x7f5b280fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 -- 10.20.193.98:0/991282690 shutdown_connections 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 -- 10.20.193.98:0/991282690 wait complete. 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 Processor -- start 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 -- start start 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 0x7f5b281997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.796+0000 7f5b2ec40640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28108150 con 0x7f5b28102ea0 2026-02-20T02:25:18.800 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b2c9b5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 0x7f5b281997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b2c9b5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 0x7f5b281997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:47094/0 (socket says 10.20.193.98:47094) 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b2c9b5640 1 -- 10.20.193.98:0/3453591635 learned_addr learned my addr 10.20.193.98:0/3453591635 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b2c9b5640 1 -- 10.20.193.98:0/3453591635 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b28199d10 con 0x7f5b28102ea0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b2c9b5640 1 --2- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 0x7f5b281997d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b18005ec0 tx=0x7f5b18004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b1dffb640 1 -- 10.20.193.98:0/3453591635 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5b18002820 con 0x7f5b28102ea0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b1dffb640 1 -- 10.20.193.98:0/3453591635 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f5b18046070 con 0x7f5b28102ea0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b28199fa0 con 0x7f5b28102ea0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b1dffb640 1 -- 10.20.193.98:0/3453591635 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5b180417b0 con 0x7f5b28102ea0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.797+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2819cc90 con 0x7f5b28102ea0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.798+0000 7f5b1dffb640 1 -- 10.20.193.98:0/3453591635 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7f5b18038770 con 0x7f5b28102ea0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.798+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b281088f0 con 0x7f5b28102ea0 2026-02-20T02:25:18.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.798+0000 7f5b1dffb640 1 --2- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f5b0403dc40 0x7f5b04040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:18.802 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.798+0000 7f5b1dffb640 1 -- 10.20.193.98:0/3453591635 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5b18076fd0 con 0x7f5b28102ea0 2026-02-20T02:25:18.802 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.798+0000 7f5b1ffff640 1 --2- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f5b0403dc40 0x7f5b04040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:18.802 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.798+0000 7f5b1ffff640 1 --2- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f5b0403dc40 0x7f5b04040100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b100099c0 tx=0x7f5b10006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:18.802 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.800+0000 7f5b1dffb640 1 -- 10.20.193.98:0/3453591635 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5b18040360 con 0x7f5b28102ea0 2026-02-20T02:25:18.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.883+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f5b28192bf0 con 0x7f5b28102ea0 2026-02-20T02:25:18.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.885+0000 7f5b1dffb640 1 -- 10.20.193.98:0/3453591635 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f5b18049360 con 0x7f5b28102ea0 2026-02-20T02:25:18.888 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f5b0403dc40 msgr2=0x7f5b04040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:18.888 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 --2- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f5b0403dc40 0x7f5b04040100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b100099c0 tx=0x7f5b10006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.888 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 msgr2=0x7f5b281997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:18.888 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 --2- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 0x7f5b281997d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b18005ec0 tx=0x7f5b18004290 comp rx=0 tx=0).stop 2026-02-20T02:25:18.889 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 shutdown_connections 2026-02-20T02:25:18.889 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 --2- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f5b0403dc40 0x7f5b04040100 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.889 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 --2- 10.20.193.98:0/3453591635 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5b28102ea0 0x7f5b281997d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:18.889 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 >> 10.20.193.98:0/3453591635 conn(0x7f5b280fc9a0 msgr2=0x7f5b280fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:18.889 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 shutdown_connections 2026-02-20T02:25:18.889 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:18.887+0000 7f5b2ec40640 1 -- 10.20.193.98:0/3453591635 wait complete. 2026-02-20T02:25:18.924 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-20T02:25:18.924 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-20T02:25:19.076 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:19.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.182+0000 7fecf0ad9640 1 -- 10.20.193.98:0/1648363671 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 msgr2=0x7fecec1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:19.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.182+0000 7fecf0ad9640 1 --2- 10.20.193.98:0/1648363671 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 0x7fecec1049b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fece00099b0 tx=0x7fece002f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:19.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 -- 10.20.193.98:0/1648363671 shutdown_connections 2026-02-20T02:25:19.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 --2- 10.20.193.98:0/1648363671 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 0x7fecec1049b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:19.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 -- 10.20.193.98:0/1648363671 >> 10.20.193.98:0/1648363671 conn(0x7fecec0ffd70 msgr2=0x7fecec102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 -- 10.20.193.98:0/1648363671 shutdown_connections 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 -- 10.20.193.98:0/1648363671 wait complete. 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 Processor -- start 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 -- start start 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 0x7fecec19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecf0ad9640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fecec10a3f0 con 0x7fecec1045b0 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecea575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 0x7fecec19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecea575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 0x7fecec19ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:47106/0 (socket says 10.20.193.98:47106) 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecea575640 1 -- 10.20.193.98:0/2977406441 learned_addr learned my addr 10.20.193.98:0/2977406441 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecea575640 1 -- 10.20.193.98:0/2977406441 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec19bfc0 con 0x7fecec1045b0 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.183+0000 7fecea575640 1 --2- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 0x7fecec19ba80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fece0004290 tx=0x7fece00042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecd37fe640 1 -- 10.20.193.98:0/2977406441 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fece0002820 con 0x7fecec1045b0 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecd37fe640 1 -- 10.20.193.98:0/2977406441 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fece0046070 con 0x7fecec1045b0 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecec19c250 con 0x7fecec1045b0 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecd37fe640 1 -- 10.20.193.98:0/2977406441 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fece00417b0 con 0x7fecec1045b0 2026-02-20T02:25:19.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecec19ef40 con 0x7fecec1045b0 2026-02-20T02:25:19.187 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecd37fe640 1 -- 10.20.193.98:0/2977406441 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7fece0038770 con 0x7fecec1045b0 2026-02-20T02:25:19.187 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecec10ab90 con 0x7fecec1045b0 2026-02-20T02:25:19.187 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecd37fe640 1 --2- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fecc403dc40 0x7fecc4040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:19.187 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fecd37fe640 1 -- 10.20.193.98:0/2977406441 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fece0077130 con 0x7fecec1045b0 2026-02-20T02:25:19.187 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.184+0000 7fece9d74640 1 --2- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fecc403dc40 0x7fecc4040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:19.187 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.185+0000 7fece9d74640 1 --2- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fecc403dc40 0x7fecc4040100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fecd40099c0 tx=0x7fecd4006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:19.187 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.187+0000 7fecd37fe640 1 -- 10.20.193.98:0/2977406441 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fece0051060 con 0x7fecec1045b0 2026-02-20T02:25:19.278 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.277+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 --> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fecec194f60 con 0x7fecc403dc40 2026-02-20T02:25:19.279 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.278+0000 7fecd37fe640 1 -- 10.20.193.98:0/2977406441 <== mgr.14162 v2:10.20.193.98:6800/892283834 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fecec194f60 con 0x7fecc403dc40 2026-02-20T02:25:19.281 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fecc403dc40 msgr2=0x7fecc4040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:19.281 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 --2- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fecc403dc40 0x7fecc4040100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fecd40099c0 tx=0x7fecd4006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:19.281 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 msgr2=0x7fecec19ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:19.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 --2- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 0x7fecec19ba80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fece0004290 tx=0x7fece00042c0 comp rx=0 tx=0).stop 2026-02-20T02:25:19.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 shutdown_connections 2026-02-20T02:25:19.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 --2- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fecc403dc40 0x7fecc4040100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:19.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 --2- 10.20.193.98:0/2977406441 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fecec1045b0 0x7fecec19ba80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:19.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 >> 10.20.193.98:0/2977406441 conn(0x7fecec0ffd70 msgr2=0x7fecec1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:19.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 shutdown_connections 2026-02-20T02:25:19.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.280+0000 7fecf0ad9640 1 -- 10.20.193.98:0/2977406441 wait complete. 2026-02-20T02:25:19.316 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial106 2026-02-20T02:25:19.317 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:25:19.317 DEBUG:teuthology.orchestra.run.trial106:> dd of=/etc/ceph/ceph.conf 2026-02-20T02:25:19.335 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:25:19.335 DEBUG:teuthology.orchestra.run.trial106:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T02:25:19.390 INFO:tasks.cephadm:Adding host trial106 to orchestrator... 2026-02-20T02:25:19.390 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch host add trial106 2026-02-20T02:25:19.552 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:19.691 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 -- 10.20.193.98:0/4220868737 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 msgr2=0x7f40501073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 --2- 10.20.193.98:0/4220868737 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 0x7f40501073e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40440099b0 tx=0x7f404402f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 -- 10.20.193.98:0/4220868737 shutdown_connections 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 --2- 10.20.193.98:0/4220868737 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 0x7f40501073e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 -- 10.20.193.98:0/4220868737 >> 10.20.193.98:0/4220868737 conn(0x7f40500fc9f0 msgr2=0x7f40500fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 -- 10.20.193.98:0/4220868737 shutdown_connections 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 -- 10.20.193.98:0/4220868737 wait complete. 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 Processor -- start 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 -- start start 2026-02-20T02:25:19.692 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 0x7f405019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f40556e4640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f405010a3c0 con 0x7f405006ac90 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f404effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 0x7f405019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f404effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 0x7f405019ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:47122/0 (socket says 10.20.193.98:47122) 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f404effd640 1 -- 10.20.193.98:0/4169139105 learned_addr learned my addr 10.20.193.98:0/4169139105 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.688+0000 7f404effd640 1 -- 10.20.193.98:0/4169139105 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405019bf90 con 0x7f405006ac90 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.689+0000 7f404effd640 1 --2- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 0x7f405019ba50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f404402f860 tx=0x7f4044004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.689+0000 7f402ffff640 1 -- 10.20.193.98:0/4169139105 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4044004590 con 0x7f405006ac90 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.689+0000 7f402ffff640 1 -- 10.20.193.98:0/4169139105 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f4044046070 con 0x7f405006ac90 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.689+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405019c220 con 0x7f405006ac90 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.689+0000 7f402ffff640 1 -- 10.20.193.98:0/4169139105 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f40440416d0 con 0x7f405006ac90 2026-02-20T02:25:19.693 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.689+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405019ef10 con 0x7f405006ac90 2026-02-20T02:25:19.694 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.689+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f405010ab60 con 0x7f405006ac90 2026-02-20T02:25:19.694 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.689+0000 7f402ffff640 1 -- 10.20.193.98:0/4169139105 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7f4044038770 con 0x7f405006ac90 2026-02-20T02:25:19.694 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.690+0000 7f402ffff640 1 --2- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f402403dde0 0x7f40240402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:19.694 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.690+0000 7f402ffff640 1 -- 10.20.193.98:0/4169139105 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4044076fa0 con 0x7f405006ac90 2026-02-20T02:25:19.694 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.690+0000 7f404e7fc640 1 --2- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f402403dde0 0x7f40240402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:19.694 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.690+0000 7f404e7fc640 1 --2- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f402403dde0 0x7f40240402a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40380099c0 tx=0x7f4038006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:19.695 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.692+0000 7f402ffff640 1 -- 10.20.193.98:0/4169139105 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4044007c50 con 0x7f405006ac90 2026-02-20T02:25:19.781 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:19.780+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 --> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial106", "target": ["mon-mgr", ""]}) -- 0x7f4050194ea0 con 0x7f402403dde0 2026-02-20T02:25:20.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3453591635' entity='client.admin' 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd/host:trial098", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: Deploying daemon ceph-exporter.trial098 on trial098 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:20.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:20.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:19 trial098 ceph-mon[38923]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial106", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:21.233 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-20T02:25:21.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-20T02:25:21.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:21.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: Deploying daemon crash.trial098 on trial098 2026-02-20T02:25:21.234 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: Deploying cephadm binary to trial106 2026-02-20T02:25:21.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:21.235 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:20 trial098 ceph-mon[38923]: Deploying daemon node-exporter.trial098 on trial098 2026-02-20T02:25:21.278 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.275+0000 7f402ffff640 1 -- 10.20.193.98:0/4169139105 <== mgr.14162 v2:10.20.193.98:6800/892283834 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f4050194ea0 con 0x7f402403dde0 2026-02-20T02:25:21.278 INFO:teuthology.orchestra.run.trial098.stdout:Added host 'trial106' with addr '10.20.193.106' 2026-02-20T02:25:21.281 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f402403dde0 msgr2=0x7f40240402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:21.281 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 --2- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f402403dde0 0x7f40240402a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40380099c0 tx=0x7f4038006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:21.281 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 msgr2=0x7f405019ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:21.281 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 --2- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 0x7f405019ba50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f404402f860 tx=0x7f4044004290 comp rx=0 tx=0).stop 2026-02-20T02:25:21.281 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 shutdown_connections 2026-02-20T02:25:21.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 --2- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f402403dde0 0x7f40240402a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:21.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 --2- 10.20.193.98:0/4169139105 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f405006ac90 0x7f405019ba50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:21.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 >> 10.20.193.98:0/4169139105 conn(0x7f40500fc9f0 msgr2=0x7f40500fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:21.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 shutdown_connections 2026-02-20T02:25:21.282 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.279+0000 7f40556e4640 1 -- 10.20.193.98:0/4169139105 wait complete. 2026-02-20T02:25:21.369 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-20T02:25:21.524 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:21.631 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.627+0000 7eff0ce28640 1 -- 10.20.193.98:0/2192429354 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 msgr2=0x7eff08100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:21.631 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.627+0000 7eff0ce28640 1 --2- 10.20.193.98:0/2192429354 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 0x7eff08100370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efefc0099b0 tx=0x7efefc02f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:21.631 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.627+0000 7eff0ce28640 1 -- 10.20.193.98:0/2192429354 shutdown_connections 2026-02-20T02:25:21.631 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.627+0000 7eff0ce28640 1 --2- 10.20.193.98:0/2192429354 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 0x7eff08100370 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.627+0000 7eff0ce28640 1 -- 10.20.193.98:0/2192429354 >> 10.20.193.98:0/2192429354 conn(0x7eff080fbd00 msgr2=0x7eff080fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.627+0000 7eff0ce28640 1 -- 10.20.193.98:0/2192429354 shutdown_connections 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.627+0000 7eff0ce28640 1 -- 10.20.193.98:0/2192429354 wait complete. 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff0ce28640 1 Processor -- start 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff0ce28640 1 -- start start 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff0ce28640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 0x7eff0819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff0ce28640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff08108130 con 0x7eff080fff70 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff06575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 0x7eff0819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff06575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 0x7eff0819ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:47164/0 (socket says 10.20.193.98:47164) 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff06575640 1 -- 10.20.193.98:0/4048836960 learned_addr learned my addr 10.20.193.98:0/4048836960 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:21.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff06575640 1 -- 10.20.193.98:0/4048836960 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0819bfc0 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff06575640 1 --2- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 0x7eff0819ba80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efefc005ec0 tx=0x7efefc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7efeef7fe640 1 -- 10.20.193.98:0/4048836960 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7efefc002820 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7efeef7fe640 1 -- 10.20.193.98:0/4048836960 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7efefc046070 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0819c250 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7efeef7fe640 1 -- 10.20.193.98:0/4048836960 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7efefc0417b0 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.628+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0819ef40 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.629+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff081088d0 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.629+0000 7efeef7fe640 1 -- 10.20.193.98:0/4048836960 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7efefc038770 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.629+0000 7efeef7fe640 1 --2- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efee003dc40 0x7efee0040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.629+0000 7efeef7fe640 1 -- 10.20.193.98:0/4048836960 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efefc077000 con 0x7eff080fff70 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.629+0000 7eff05d74640 1 --2- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efee003dc40 0x7efee0040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:21.633 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.629+0000 7eff05d74640 1 --2- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efee003dc40 0x7efee0040100 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efef00099c0 tx=0x7efef0006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:21.634 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.631+0000 7efeef7fe640 1 -- 10.20.193.98:0/4048836960 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efefc040360 con 0x7eff080fff70 2026-02-20T02:25:21.718 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.716+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 --> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff08195110 con 0x7efee003dc40 2026-02-20T02:25:21.718 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.717+0000 7efeef7fe640 1 -- 10.20.193.98:0/4048836960 <== mgr.14162 v2:10.20.193.98:6800/892283834 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7eff08195110 con 0x7efee003dc40 2026-02-20T02:25:21.719 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:21.719 INFO:teuthology.orchestra.run.trial098.stdout:[{"addr": "10.20.193.98", "hostname": "trial098", "labels": [], "status": ""}, {"addr": "10.20.193.106", "hostname": "trial106", "labels": [], "status": ""}] 2026-02-20T02:25:21.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efee003dc40 msgr2=0x7efee0040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:21.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 --2- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efee003dc40 0x7efee0040100 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efef00099c0 tx=0x7efef0006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:21.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 msgr2=0x7eff0819ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:21.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 --2- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 0x7eff0819ba80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efefc005ec0 tx=0x7efefc004290 comp rx=0 tx=0).stop 2026-02-20T02:25:21.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 shutdown_connections 2026-02-20T02:25:21.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 --2- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efee003dc40 0x7efee0040100 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:21.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 --2- 10.20.193.98:0/4048836960 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff080fff70 0x7eff0819ba80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:21.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 >> 10.20.193.98:0/4048836960 conn(0x7eff080fbd00 msgr2=0x7eff080fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:21.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 shutdown_connections 2026-02-20T02:25:21.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:21.718+0000 7eff0ce28640 1 -- 10.20.193.98:0/4048836960 wait complete. 2026-02-20T02:25:21.756 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-20T02:25:21.756 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd crush tunables default 2026-02-20T02:25:22.044 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 -- 10.20.193.98:0/4004661159 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 msgr2=0x7f9598102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 --2- 10.20.193.98:0/4004661159 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 0x7f9598102730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f95880099b0 tx=0x7f958802f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 -- 10.20.193.98:0/4004661159 shutdown_connections 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 --2- 10.20.193.98:0/4004661159 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 0x7f9598102730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 -- 10.20.193.98:0/4004661159 >> 10.20.193.98:0/4004661159 conn(0x7f95980fdae0 msgr2=0x7f95980fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 -- 10.20.193.98:0/4004661159 shutdown_connections 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 -- 10.20.193.98:0/4004661159 wait complete. 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 Processor -- start 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 -- start start 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 0x7f9598076d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.155+0000 7f95a0695640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9598108170 con 0x7f9598102330 2026-02-20T02:25:22.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f959e40a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 0x7f9598076d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f959e40a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 0x7f9598076d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:47184/0 (socket says 10.20.193.98:47184) 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f959e40a640 1 -- 10.20.193.98:0/512056814 learned_addr learned my addr 10.20.193.98:0/512056814 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f959e40a640 1 -- 10.20.193.98:0/512056814 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9598077270 con 0x7f9598102330 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f959e40a640 1 --2- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 0x7f9598076d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9588004290 tx=0x7f95880042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f957f7fe640 1 -- 10.20.193.98:0/512056814 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9588002820 con 0x7f9598102330 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f957f7fe640 1 -- 10.20.193.98:0/512056814 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9588046070 con 0x7f9598102330 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9598075460 con 0x7f9598102330 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f957f7fe640 1 -- 10.20.193.98:0/512056814 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f95880417b0 con 0x7f9598102330 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9598075940 con 0x7f9598102330 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9598108910 con 0x7f9598102330 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.156+0000 7f957f7fe640 1 -- 10.20.193.98:0/512056814 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7f9588038770 con 0x7f9598102330 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.157+0000 7f957f7fe640 1 --2- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f957403dc40 0x7f9574040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:22.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.157+0000 7f957f7fe640 1 -- 10.20.193.98:0/512056814 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9588077110 con 0x7f9598102330 2026-02-20T02:25:22.159 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.157+0000 7f959dc09640 1 --2- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f957403dc40 0x7f9574040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:22.159 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.157+0000 7f959dc09640 1 --2- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f957403dc40 0x7f9574040100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f958c0099c0 tx=0x7f958c006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:22.160 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.159+0000 7f957f7fe640 1 -- 10.20.193.98:0/512056814 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f958804ade0 con 0x7f9598102330 2026-02-20T02:25:22.246 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.245+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f9598192b70 con 0x7f9598102330 2026-02-20T02:25:22.273 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:22.273+0000 7f957f7fe640 1 -- 10.20.193.98:0/512056814 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mgrmap(e 13) ==== 50317+0+0 (secure 0 0 0) 0x7f958804b460 con 0x7f9598102330 2026-02-20T02:25:22.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:22 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:22.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:22 trial098 ceph-mon[38923]: Added host trial106 2026-02-20T02:25:22.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:22 trial098 ceph-mon[38923]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T02:25:22.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:22 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:22.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:22 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:22.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:22 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:22.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:22 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:22.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:22 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/512056814' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-20T02:25:23.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.058+0000 7f957f7fe640 1 -- 10.20.193.98:0/512056814 <== mon.0 v2:10.20.193.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f9588030cf0 con 0x7f9598102330 2026-02-20T02:25:23.059 INFO:teuthology.orchestra.run.trial098.stderr:adjusted tunables profile to default 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f957403dc40 msgr2=0x7f9574040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 --2- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f957403dc40 0x7f9574040100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f958c0099c0 tx=0x7f958c006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 msgr2=0x7f9598076d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 --2- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 0x7f9598076d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9588004290 tx=0x7f95880042c0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 shutdown_connections 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 --2- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f957403dc40 0x7f9574040100 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 --2- 10.20.193.98:0/512056814 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9598102330 0x7f9598076d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 >> 10.20.193.98:0/512056814 conn(0x7f95980fdae0 msgr2=0x7f95980fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 shutdown_connections 2026-02-20T02:25:23.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:23.061+0000 7f95a0695640 1 -- 10.20.193.98:0/512056814 wait complete. 2026-02-20T02:25:23.243 INFO:tasks.cephadm:Adding mon.trial098 on trial098 2026-02-20T02:25:23.243 INFO:tasks.cephadm:Adding mon.trial106 on trial106 2026-02-20T02:25:23.243 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch apply mon '2;trial098:10.20.193.98=trial098;trial106:10.20.193.106=trial106' 2026-02-20T02:25:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:23 trial098 ceph-mon[38923]: Deploying daemon alertmanager.trial098 on trial098 2026-02-20T02:25:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:23 trial098 ceph-mon[38923]: mgrmap e13: trial098.hiicxh(active, since 6s) 2026-02-20T02:25:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:23 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/512056814' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-20T02:25:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:23 trial098 ceph-mon[38923]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T02:25:23.389 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:23.418 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:23.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.532+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/2808554654 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 msgr2=0x7ff9c8075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:23.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.532+0000 7ff9cfe1d640 1 --2- 10.20.193.106:0/2808554654 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 0x7ff9c8075500 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80099b0 tx=0x7ff9b802f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.532+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/2808554654 shutdown_connections 2026-02-20T02:25:23.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.532+0000 7ff9cfe1d640 1 --2- 10.20.193.106:0/2808554654 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 0x7ff9c8075500 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.532+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/2808554654 >> 10.20.193.106:0/2808554654 conn(0x7ff9c80fdae0 msgr2=0x7ff9c80fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:23.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.532+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/2808554654 shutdown_connections 2026-02-20T02:25:23.536 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.532+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/2808554654 wait complete. 2026-02-20T02:25:23.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.533+0000 7ff9cfe1d640 1 Processor -- start 2026-02-20T02:25:23.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.533+0000 7ff9cfe1d640 1 -- start start 2026-02-20T02:25:23.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.533+0000 7ff9cfe1d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 0x7ff9c819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:23.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.533+0000 7ff9cfe1d640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c810a3d0 con 0x7ff9c80770a0 2026-02-20T02:25:23.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.533+0000 7ff9cdb92640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 0x7ff9c819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:23.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.534+0000 7ff9cdb92640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 0x7ff9c819ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:35294/0 (socket says 10.20.193.106:35294) 2026-02-20T02:25:23.537 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.534+0000 7ff9cdb92640 1 -- 10.20.193.106:0/3660167126 learned_addr learned my addr 10.20.193.106:0/3660167126 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.534+0000 7ff9cdb92640 1 -- 10.20.193.106:0/3660167126 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c819bf80 con 0x7ff9c80770a0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.535+0000 7ff9cdb92640 1 --2- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 0x7ff9c819ba40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff9b802f860 tx=0x7ff9b8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.535+0000 7ff9b6ffd640 1 -- 10.20.193.106:0/3660167126 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff9b8004590 con 0x7ff9c80770a0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.535+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c819c210 con 0x7ff9c80770a0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.535+0000 7ff9b6ffd640 1 -- 10.20.193.106:0/3660167126 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff9b8046070 con 0x7ff9c80770a0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.535+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c819ef00 con 0x7ff9c80770a0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.535+0000 7ff9b6ffd640 1 -- 10.20.193.106:0/3660167126 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff9b804b730 con 0x7ff9c80770a0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.535+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c810ab70 con 0x7ff9c80770a0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.536+0000 7ff9b6ffd640 1 -- 10.20.193.106:0/3660167126 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 13) ==== 50317+0+0 (secure 0 0 0) 0x7ff9b8038770 con 0x7ff9c80770a0 2026-02-20T02:25:23.539 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.536+0000 7ff9b6ffd640 1 --2- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff9a403de80 0x7ff9a4040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:23.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.536+0000 7ff9b6ffd640 1 -- 10.20.193.106:0/3660167126 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff9b80771d0 con 0x7ff9c80770a0 2026-02-20T02:25:23.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.537+0000 7ff9cd391640 1 --2- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff9a403de80 0x7ff9a4040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:23.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.538+0000 7ff9cd391640 1 --2- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff9a403de80 0x7ff9a4040340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0099c0 tx=0x7ff9bc006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:23.540 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.538+0000 7ff9b6ffd640 1 -- 10.20.193.106:0/3660167126 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff9b8033210 con 0x7ff9c80770a0 2026-02-20T02:25:23.630 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.628+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 --> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;trial098:10.20.193.98=trial098;trial106:10.20.193.106=trial106", "target": ["mon-mgr", ""]}) -- 0x7ff9c8194f60 con 0x7ff9a403de80 2026-02-20T02:25:23.634 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.632+0000 7ff9b6ffd640 1 -- 10.20.193.106:0/3660167126 <== mgr.14162 v2:10.20.193.98:6800/892283834 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff9c8194f60 con 0x7ff9a403de80 2026-02-20T02:25:23.634 INFO:teuthology.orchestra.run.trial106.stdout:Scheduled mon update... 2026-02-20T02:25:23.635 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff9a403de80 msgr2=0x7ff9a4040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 --2- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff9a403de80 0x7ff9a4040340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0099c0 tx=0x7ff9bc006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 msgr2=0x7ff9c819ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 --2- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 0x7ff9c819ba40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff9b802f860 tx=0x7ff9b8004290 comp rx=0 tx=0).stop 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 shutdown_connections 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 --2- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff9a403de80 0x7ff9a4040340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 --2- 10.20.193.106:0/3660167126 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff9c80770a0 0x7ff9c819ba40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 >> 10.20.193.106:0/3660167126 conn(0x7ff9c80fdae0 msgr2=0x7ff9c80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 shutdown_connections 2026-02-20T02:25:23.636 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.633+0000 7ff9cfe1d640 1 -- 10.20.193.106:0/3660167126 wait complete. 2026-02-20T02:25:23.669 DEBUG:teuthology.orchestra.run.trial106:mon.trial106> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial106.service 2026-02-20T02:25:23.670 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:23.670 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:23.850 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:23.878 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:24.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcaaffd640 1 -- 10.20.193.106:0/1085661860 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fbc98038470 con 0x7fbcac077aa0 2026-02-20T02:25:24.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 -- 10.20.193.106:0/1085661860 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 msgr2=0x7fbcac077ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:24.000 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 --2- 10.20.193.106:0/1085661860 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 0x7fbcac077ea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc980099b0 tx=0x7fbc9802f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 -- 10.20.193.106:0/1085661860 shutdown_connections 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 --2- 10.20.193.106:0/1085661860 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 0x7fbcac077ea0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 -- 10.20.193.106:0/1085661860 >> 10.20.193.106:0/1085661860 conn(0x7fbcac0ffd70 msgr2=0x7fbcac102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 -- 10.20.193.106:0/1085661860 shutdown_connections 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 -- 10.20.193.106:0/1085661860 wait complete. 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 Processor -- start 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 -- start start 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 0x7fbcac19ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.995+0000 7fbcb29b4640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac10ea10 con 0x7fbcac077aa0 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbcabfff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 0x7fbcac19ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:24.001 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbcabfff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 0x7fbcac19ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:35316/0 (socket says 10.20.193.106:35316) 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbcabfff640 1 -- 10.20.193.106:0/4169735824 learned_addr learned my addr 10.20.193.106:0/4169735824 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbcabfff640 1 -- 10.20.193.106:0/4169735824 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac1a0480 con 0x7fbcac077aa0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbcabfff640 1 --2- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 0x7fbcac19ff40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbc98005ec0 tx=0x7fbc98004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbca97fa640 1 -- 10.20.193.106:0/4169735824 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fbc98002820 con 0x7fbcac077aa0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbca97fa640 1 -- 10.20.193.106:0/4169735824 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fbc98046070 con 0x7fbcac077aa0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac1a0710 con 0x7fbcac077aa0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbca97fa640 1 -- 10.20.193.106:0/4169735824 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fbc98041750 con 0x7fbcac077aa0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.996+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac1a3400 con 0x7fbcac077aa0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.997+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac10f070 con 0x7fbcac077aa0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.997+0000 7fbca97fa640 1 -- 10.20.193.106:0/4169735824 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 13) ==== 50317+0+0 (secure 0 0 0) 0x7fbc98038770 con 0x7fbcac077aa0 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.997+0000 7fbca97fa640 1 --2- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fbc8003dc90 0x7fbc80040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:24.002 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.997+0000 7fbca97fa640 1 -- 10.20.193.106:0/4169735824 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbc98077190 con 0x7fbcac077aa0 2026-02-20T02:25:24.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.997+0000 7fbcab7fe640 1 --2- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fbc8003dc90 0x7fbc80040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:24.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.998+0000 7fbcab7fe640 1 --2- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fbc8003dc90 0x7fbc80040150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0099c0 tx=0x7fbc9c006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:24.003 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:23.999+0000 7fbca97fa640 1 -- 10.20.193.106:0/4169735824 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fbc98035320 con 0x7fbcac077aa0 2026-02-20T02:25:24.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.118+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbcac199300 con 0x7fbcac077aa0 2026-02-20T02:25:24.120 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.118+0000 7fbca97fa640 1 -- 10.20.193.106:0/4169735824 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7fbc98049360 con 0x7fbcac077aa0 2026-02-20T02:25:24.121 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:24.121 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:24.122 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:24.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fbc8003dc90 msgr2=0x7fbc80040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:24.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 --2- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fbc8003dc90 0x7fbc80040150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0099c0 tx=0x7fbc9c006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:24.122 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 msgr2=0x7fbcac19ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:24.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 --2- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 0x7fbcac19ff40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbc98005ec0 tx=0x7fbc98004290 comp rx=0 tx=0).stop 2026-02-20T02:25:24.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 shutdown_connections 2026-02-20T02:25:24.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 --2- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fbc8003dc90 0x7fbc80040150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:24.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 --2- 10.20.193.106:0/4169735824 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbcac077aa0 0x7fbcac19ff40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:24.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 >> 10.20.193.106:0/4169735824 conn(0x7fbcac0ffd70 msgr2=0x7fbcac1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:24.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 shutdown_connections 2026-02-20T02:25:24.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:24.119+0000 7fbcb29b4640 1 -- 10.20.193.106:0/4169735824 wait complete. 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;trial098:10.20.193.98=trial098;trial106:10.20.193.106=trial106", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: Saving service mon spec with placement trial098:10.20.193.98=trial098;trial106:10.20.193.106=trial106;count:2 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: Regenerating cephadm self-signed grafana TLS certificates 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-20T02:25:24.917 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-20T02:25:24.918 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:24.918 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: Deploying daemon grafana.trial098 on trial098 2026-02-20T02:25:24.918 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:24 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/4169735824' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:25.160 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:25.160 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:25.302 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:25.331 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:25.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 -- 10.20.193.106:0/4257614832 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 msgr2=0x7efc50077ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:25.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 --2- 10.20.193.106:0/4257614832 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 0x7efc50077ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0099b0 tx=0x7efc3c02f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:25.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 -- 10.20.193.106:0/4257614832 shutdown_connections 2026-02-20T02:25:25.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 --2- 10.20.193.106:0/4257614832 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 0x7efc50077ea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:25.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 -- 10.20.193.106:0/4257614832 >> 10.20.193.106:0/4257614832 conn(0x7efc500ffd70 msgr2=0x7efc50102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:25.454 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 -- 10.20.193.106:0/4257614832 shutdown_connections 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 -- 10.20.193.106:0/4257614832 wait complete. 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 Processor -- start 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 -- start start 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 0x7efc5019ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.451+0000 7efc561fb640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc5010ea10 con 0x7efc50077aa0 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc4f7fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 0x7efc5019ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc4f7fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 0x7efc5019ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:35332/0 (socket says 10.20.193.106:35332) 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc4f7fe640 1 -- 10.20.193.106:0/2164298368 learned_addr learned my addr 10.20.193.106:0/2164298368 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc4f7fe640 1 -- 10.20.193.106:0/2164298368 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc501a0480 con 0x7efc50077aa0 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc4f7fe640 1 --2- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 0x7efc5019ff40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc3c005ec0 tx=0x7efc3c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:25.455 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc4cff9640 1 -- 10.20.193.106:0/2164298368 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7efc3c002820 con 0x7efc50077aa0 2026-02-20T02:25:25.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc4cff9640 1 -- 10.20.193.106:0/2164298368 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7efc3c046070 con 0x7efc50077aa0 2026-02-20T02:25:25.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc501a0710 con 0x7efc50077aa0 2026-02-20T02:25:25.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501a3400 con 0x7efc50077aa0 2026-02-20T02:25:25.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.452+0000 7efc4cff9640 1 -- 10.20.193.106:0/2164298368 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7efc3c041750 con 0x7efc50077aa0 2026-02-20T02:25:25.456 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.453+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5010f070 con 0x7efc50077aa0 2026-02-20T02:25:25.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.453+0000 7efc4cff9640 1 -- 10.20.193.106:0/2164298368 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 13) ==== 50317+0+0 (secure 0 0 0) 0x7efc3c0418f0 con 0x7efc50077aa0 2026-02-20T02:25:25.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.453+0000 7efc4cff9640 1 --2- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc2403dc90 0x7efc24040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:25.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.453+0000 7efc4cff9640 1 -- 10.20.193.106:0/2164298368 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efc3c077350 con 0x7efc50077aa0 2026-02-20T02:25:25.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.453+0000 7efc4effd640 1 --2- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc2403dc90 0x7efc24040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:25.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.454+0000 7efc4effd640 1 --2- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc2403dc90 0x7efc24040150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efc400099c0 tx=0x7efc40006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:25.457 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.455+0000 7efc4cff9640 1 -- 10.20.193.106:0/2164298368 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efc3c047270 con 0x7efc50077aa0 2026-02-20T02:25:25.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.572+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7efc50199300 con 0x7efc50077aa0 2026-02-20T02:25:25.574 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.572+0000 7efc4cff9640 1 -- 10.20.193.106:0/2164298368 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7efc3c041c10 con 0x7efc50077aa0 2026-02-20T02:25:25.574 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:25.574 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:25.575 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:25.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc2403dc90 msgr2=0x7efc24040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:25.575 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 --2- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc2403dc90 0x7efc24040150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efc400099c0 tx=0x7efc40006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:25.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 msgr2=0x7efc5019ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:25.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 --2- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 0x7efc5019ff40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc3c005ec0 tx=0x7efc3c004290 comp rx=0 tx=0).stop 2026-02-20T02:25:25.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 shutdown_connections 2026-02-20T02:25:25.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 --2- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7efc2403dc90 0x7efc24040150 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:25.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 --2- 10.20.193.106:0/2164298368 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7efc50077aa0 0x7efc5019ff40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:25.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 >> 10.20.193.106:0/2164298368 conn(0x7efc500ffd70 msgr2=0x7efc501007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:25.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 shutdown_connections 2026-02-20T02:25:25.576 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:25.573+0000 7efc561fb640 1 -- 10.20.193.106:0/2164298368 wait complete. 2026-02-20T02:25:26.608 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:26.609 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:26.750 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:26.753 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:26 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:26.753 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:26 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/2164298368' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:26.780 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:26.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 -- 10.20.193.106:0/1708006867 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 msgr2=0x7f9d501047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:26.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 --2- 10.20.193.106:0/1708006867 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 0x7f9d501047f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d400099b0 tx=0x7f9d4002f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:26.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 -- 10.20.193.106:0/1708006867 shutdown_connections 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 --2- 10.20.193.106:0/1708006867 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 0x7f9d501047f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 -- 10.20.193.106:0/1708006867 >> 10.20.193.106:0/1708006867 conn(0x7f9d500ffba0 msgr2=0x7f9d50101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 -- 10.20.193.106:0/1708006867 shutdown_connections 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 -- 10.20.193.106:0/1708006867 wait complete. 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 Processor -- start 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 -- start start 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 0x7f9d5019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.887+0000 7f9d561b5640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5010a230 con 0x7f9d501043f0 2026-02-20T02:25:26.889 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d551b3640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 0x7f9d5019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d551b3640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 0x7f9d5019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:35344/0 (socket says 10.20.193.106:35344) 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d551b3640 1 -- 10.20.193.106:0/3060361793 learned_addr learned my addr 10.20.193.106:0/3060361793 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d551b3640 1 -- 10.20.193.106:0/3060361793 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5019bde0 con 0x7f9d501043f0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d551b3640 1 --2- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 0x7f9d5019b8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d4002f860 tx=0x7f9d40004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d3e7fc640 1 -- 10.20.193.106:0/3060361793 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9d40004590 con 0x7f9d501043f0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5019c070 con 0x7f9d501043f0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d3e7fc640 1 -- 10.20.193.106:0/3060361793 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9d40046070 con 0x7f9d501043f0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.888+0000 7f9d3e7fc640 1 -- 10.20.193.106:0/3060361793 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9d400416d0 con 0x7f9d501043f0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.889+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5019ed60 con 0x7f9d501043f0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.889+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5010a9d0 con 0x7f9d501043f0 2026-02-20T02:25:26.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.890+0000 7f9d3e7fc640 1 -- 10.20.193.106:0/3060361793 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 13) ==== 50317+0+0 (secure 0 0 0) 0x7f9d40038770 con 0x7f9d501043f0 2026-02-20T02:25:26.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.890+0000 7f9d3e7fc640 1 --2- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9d2c03de80 0x7f9d2c040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:26.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.890+0000 7f9d3e7fc640 1 -- 10.20.193.106:0/3060361793 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9d40077900 con 0x7f9d501043f0 2026-02-20T02:25:26.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.890+0000 7f9d549b2640 1 --2- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9d2c03de80 0x7f9d2c040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:26.892 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.891+0000 7f9d549b2640 1 --2- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9d2c03de80 0x7f9d2c040340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9d440099c0 tx=0x7f9d44006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:26.893 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:26.892+0000 7f9d3e7fc640 1 -- 10.20.193.106:0/3060361793 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9d40047270 con 0x7f9d501043f0 2026-02-20T02:25:27.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.008+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9d50194c60 con 0x7f9d501043f0 2026-02-20T02:25:27.009 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d3e7fc640 1 -- 10.20.193.106:0/3060361793 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7f9d40036df0 con 0x7f9d501043f0 2026-02-20T02:25:27.010 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:27.010 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:27.010 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:27.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9d2c03de80 msgr2=0x7f9d2c040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:27.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 --2- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9d2c03de80 0x7f9d2c040340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9d440099c0 tx=0x7f9d44006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:27.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 msgr2=0x7f9d5019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:27.010 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 --2- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 0x7f9d5019b8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d4002f860 tx=0x7f9d40004290 comp rx=0 tx=0).stop 2026-02-20T02:25:27.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 shutdown_connections 2026-02-20T02:25:27.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 --2- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f9d2c03de80 0x7f9d2c040340 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:27.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 --2- 10.20.193.106:0/3060361793 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9d501043f0 0x7f9d5019b8a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:27.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 >> 10.20.193.106:0/3060361793 conn(0x7f9d500ffba0 msgr2=0x7f9d501005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:27.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.009+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 shutdown_connections 2026-02-20T02:25:27.011 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:27.010+0000 7f9d561b5640 1 -- 10.20.193.106:0/3060361793 wait complete. 2026-02-20T02:25:27.635 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/3060361793' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:27.635 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:27.635 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:27.635 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:27.635 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:27.635 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:27.635 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:27.636 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:27.636 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:27 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:28.045 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:28.045 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:28.187 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:28.216 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1610673672 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 msgr2=0x7fa9981049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 --2- 10.20.193.106:0/1610673672 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 0x7fa9981049e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0099b0 tx=0x7fa98c02f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1610673672 shutdown_connections 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 --2- 10.20.193.106:0/1610673672 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 0x7fa9981049e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1610673672 >> 10.20.193.106:0/1610673672 conn(0x7fa9980ffd70 msgr2=0x7fa9981021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1610673672 shutdown_connections 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1610673672 wait complete. 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 Processor -- start 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 -- start start 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 0x7fa99819ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa99ccc0640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa99810a420 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa996575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 0x7fa99819ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa996575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 0x7fa99819ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:50658/0 (socket says 10.20.193.106:50658) 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.328+0000 7fa996575640 1 -- 10.20.193.106:0/1878154235 learned_addr learned my addr 10.20.193.106:0/1878154235 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.329+0000 7fa996575640 1 -- 10.20.193.106:0/1878154235 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99819bfd0 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.329+0000 7fa996575640 1 --2- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 0x7fa99819ba90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa98c004290 tx=0x7fa98c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.329+0000 7fa97f7fe640 1 -- 10.20.193.106:0/1878154235 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa98c002820 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.329+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99819c260 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.329+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99819ef50 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.329+0000 7fa97f7fe640 1 -- 10.20.193.106:0/1878154235 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa98c046070 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.329+0000 7fa97f7fe640 1 -- 10.20.193.106:0/1878154235 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa98c0415b0 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.330+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa99819c740 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.330+0000 7fa97f7fe640 1 -- 10.20.193.106:0/1878154235 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 13) ==== 50317+0+0 (secure 0 0 0) 0x7fa98c038770 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.330+0000 7fa97f7fe640 1 --2- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa97003dce0 0x7fa9700401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.330+0000 7fa97f7fe640 1 -- 10.20.193.106:0/1878154235 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa98c0773a0 con 0x7fa9981045e0 2026-02-20T02:25:28.332 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.330+0000 7fa995d74640 1 --2- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa97003dce0 0x7fa9700401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:28.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.331+0000 7fa995d74640 1 --2- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa97003dce0 0x7fa9700401a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9800099c0 tx=0x7fa980006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:28.333 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.333+0000 7fa97f7fe640 1 -- 10.20.193.106:0/1878154235 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa99819c740 con 0x7fa9981045e0 2026-02-20T02:25:28.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.447+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa998194e00 con 0x7fa9981045e0 2026-02-20T02:25:28.448 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.447+0000 7fa97f7fe640 1 -- 10.20.193.106:0/1878154235 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7fa98c035320 con 0x7fa9981045e0 2026-02-20T02:25:28.449 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:28.449 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:28.450 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:28.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa97003dce0 msgr2=0x7fa9700401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:28.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 --2- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa97003dce0 0x7fa9700401a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9800099c0 tx=0x7fa980006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:28.450 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 msgr2=0x7fa99819ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:28.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 --2- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 0x7fa99819ba90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa98c004290 tx=0x7fa98c0042c0 comp rx=0 tx=0).stop 2026-02-20T02:25:28.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 shutdown_connections 2026-02-20T02:25:28.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 --2- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7fa97003dce0 0x7fa9700401a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:28.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 --2- 10.20.193.106:0/1878154235 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa9981045e0 0x7fa99819ba90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:28.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 >> 10.20.193.106:0/1878154235 conn(0x7fa9980ffd70 msgr2=0x7fa998100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:28.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 shutdown_connections 2026-02-20T02:25:28.451 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:28.448+0000 7fa99ccc0640 1 -- 10.20.193.106:0/1878154235 wait complete. 2026-02-20T02:25:28.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:28 trial098 ceph-mon[38923]: Deploying daemon prometheus.trial098 on trial098 2026-02-20T02:25:28.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:28 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/1878154235' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:29.484 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:29.484 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:29.626 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:29.656 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:29.768 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.767+0000 7ff2f7577640 1 -- 10.20.193.106:0/780351008 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 msgr2=0x7ff2f8102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.767+0000 7ff2f7577640 1 --2- 10.20.193.106:0/780351008 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 0x7ff2f8102550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0099b0 tx=0x7ff2ec02f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.767+0000 7ff2f7577640 1 -- 10.20.193.106:0/780351008 shutdown_connections 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.767+0000 7ff2f7577640 1 --2- 10.20.193.106:0/780351008 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 0x7ff2f8102550 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.767+0000 7ff2f7577640 1 -- 10.20.193.106:0/780351008 >> 10.20.193.106:0/780351008 conn(0x7ff2f80fd8e0 msgr2=0x7ff2f80ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.767+0000 7ff2f7577640 1 -- 10.20.193.106:0/780351008 shutdown_connections 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.767+0000 7ff2f7577640 1 -- 10.20.193.106:0/780351008 wait complete. 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.768+0000 7ff2f7577640 1 Processor -- start 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.768+0000 7ff2f7577640 1 -- start start 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.768+0000 7ff2f7577640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 0x7ff2f819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.768+0000 7ff2f7577640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8107f90 con 0x7ff2f8102150 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.768+0000 7ff2f6575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 0x7ff2f819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.768+0000 7ff2f6575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 0x7ff2f819b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:50676/0 (socket says 10.20.193.106:50676) 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.768+0000 7ff2f6575640 1 -- 10.20.193.106:0/101001192 learned_addr learned my addr 10.20.193.106:0/101001192 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:29.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.768+0000 7ff2f6575640 1 -- 10.20.193.106:0/101001192 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f819bdf0 con 0x7ff2f8102150 2026-02-20T02:25:29.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.769+0000 7ff2f6575640 1 --2- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 0x7ff2f819b8b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec02f860 tx=0x7ff2ec004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:29.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.769+0000 7ff2df7fe640 1 -- 10.20.193.106:0/101001192 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2ec004590 con 0x7ff2f8102150 2026-02-20T02:25:29.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.769+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f819c080 con 0x7ff2f8102150 2026-02-20T02:25:29.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.769+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f819ed70 con 0x7ff2f8102150 2026-02-20T02:25:29.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.769+0000 7ff2df7fe640 1 -- 10.20.193.106:0/101001192 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff2ec046070 con 0x7ff2f8102150 2026-02-20T02:25:29.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.769+0000 7ff2df7fe640 1 -- 10.20.193.106:0/101001192 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff2ec04b460 con 0x7ff2f8102150 2026-02-20T02:25:29.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.769+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f8108730 con 0x7ff2f8102150 2026-02-20T02:25:29.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.770+0000 7ff2df7fe640 1 -- 10.20.193.106:0/101001192 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 13) ==== 50317+0+0 (secure 0 0 0) 0x7ff2ec038770 con 0x7ff2f8102150 2026-02-20T02:25:29.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.770+0000 7ff2df7fe640 1 --2- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff2d003de80 0x7ff2d0040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:29.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.770+0000 7ff2df7fe640 1 -- 10.20.193.106:0/101001192 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff2ec077210 con 0x7ff2f8102150 2026-02-20T02:25:29.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.770+0000 7ff2f5d74640 1 --2- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff2d003de80 0x7ff2d0040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:29.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.771+0000 7ff2f5d74640 1 --2- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff2d003de80 0x7ff2d0040340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00099c0 tx=0x7ff2e0006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:29.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.772+0000 7ff2df7fe640 1 -- 10.20.193.106:0/101001192 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff2ec035320 con 0x7ff2f8102150 2026-02-20T02:25:29.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.886+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff2f81025d0 con 0x7ff2f8102150 2026-02-20T02:25:29.888 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.886+0000 7ff2df7fe640 1 -- 10.20.193.106:0/101001192 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7ff2ec075b20 con 0x7ff2f8102150 2026-02-20T02:25:29.888 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:29.889 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:29.890 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:29.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff2d003de80 msgr2=0x7ff2d0040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:29.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 --2- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff2d003de80 0x7ff2d0040340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00099c0 tx=0x7ff2e0006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:29.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 msgr2=0x7ff2f819b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:29.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 --2- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 0x7ff2f819b8b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec02f860 tx=0x7ff2ec004290 comp rx=0 tx=0).stop 2026-02-20T02:25:29.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 shutdown_connections 2026-02-20T02:25:29.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 --2- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7ff2d003de80 0x7ff2d0040340 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:29.890 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 --2- 10.20.193.106:0/101001192 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff2f8102150 0x7ff2f819b8b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:29.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 >> 10.20.193.106:0/101001192 conn(0x7ff2f80fd8e0 msgr2=0x7ff2f80fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:29.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 shutdown_connections 2026-02-20T02:25:29.891 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:29.887+0000 7ff2f7577640 1 -- 10.20.193.106:0/101001192 wait complete. 2026-02-20T02:25:30.923 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:30.924 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:30 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:30 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:30 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:30 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-02-20T02:25:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:30 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/101001192' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:30 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:31.066 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:31.094 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.206+0000 7f5195514640 1 -- 10.20.193.106:0/3528357403 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5180038470 con 0x7f5190102330 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 -- 10.20.193.106:0/3528357403 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 msgr2=0x7f5190102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 --2- 10.20.193.106:0/3528357403 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 0x7f5190102730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f51800099b0 tx=0x7f518002f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 -- 10.20.193.106:0/3528357403 shutdown_connections 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 --2- 10.20.193.106:0/3528357403 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 0x7f5190102730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 -- 10.20.193.106:0/3528357403 >> 10.20.193.106:0/3528357403 conn(0x7f51900fdae0 msgr2=0x7f51900fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 -- 10.20.193.106:0/3528357403 shutdown_connections 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 -- 10.20.193.106:0/3528357403 wait complete. 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 Processor -- start 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 -- start start 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 0x7f5190076d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:31.208 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f51987a1640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5190108170 con 0x7f5190102330 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f5196516640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 0x7f5190076d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f5196516640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 0x7f5190076d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:50696/0 (socket says 10.20.193.106:50696) 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.207+0000 7f5196516640 1 -- 10.20.193.106:0/3724963259 learned_addr learned my addr 10.20.193.106:0/3724963259 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.208+0000 7f5196516640 1 -- 10.20.193.106:0/3724963259 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5190077270 con 0x7f5190102330 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.208+0000 7f5196516640 1 --2- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 0x7f5190076d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5180004290 tx=0x7f51800042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.208+0000 7f51777fe640 1 -- 10.20.193.106:0/3724963259 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5180002820 con 0x7f5190102330 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.208+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5190075460 con 0x7f5190102330 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.208+0000 7f51777fe640 1 -- 10.20.193.106:0/3724963259 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f5180046070 con 0x7f5190102330 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.208+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5190075940 con 0x7f5190102330 2026-02-20T02:25:31.209 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.208+0000 7f51777fe640 1 -- 10.20.193.106:0/3724963259 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f518004b7e0 con 0x7f5190102330 2026-02-20T02:25:31.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.209+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5190108910 con 0x7f5190102330 2026-02-20T02:25:31.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.209+0000 7f51777fe640 1 -- 10.20.193.106:0/3724963259 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 14) ==== 50331+0+0 (secure 0 0 0) 0x7f518004b980 con 0x7f5190102330 2026-02-20T02:25:31.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.210+0000 7f51777fe640 1 --2- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f516c03dd30 0x7f516c0401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:31.210 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.210+0000 7f51777fe640 1 -- 10.20.193.106:0/3724963259 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5180077450 con 0x7f5190102330 2026-02-20T02:25:31.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.210+0000 7f5195d15640 1 -- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f516c03dd30 msgr2=0x7f516c0401f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/892283834 2026-02-20T02:25:31.211 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.210+0000 7f5195d15640 1 --2- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f516c03dd30 0x7f516c0401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T02:25:31.213 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.212+0000 7f51777fe640 1 -- 10.20.193.106:0/3724963259 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5180047270 con 0x7f5190102330 2026-02-20T02:25:31.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.332+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5190192b70 con 0x7f5190102330 2026-02-20T02:25:31.334 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.332+0000 7f51777fe640 1 -- 10.20.193.106:0/3724963259 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7f5180049e10 con 0x7f5190102330 2026-02-20T02:25:31.334 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:31.334 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:31.335 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f516c03dd30 msgr2=0x7f516c0401f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 --2- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f516c03dd30 0x7f516c0401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 msgr2=0x7f5190076d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 --2- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 0x7f5190076d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5180004290 tx=0x7f51800042c0 comp rx=0 tx=0).stop 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 shutdown_connections 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 --2- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f516c03dd30 0x7f516c0401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 --2- 10.20.193.106:0/3724963259 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5190102330 0x7f5190076d30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 >> 10.20.193.106:0/3724963259 conn(0x7f51900fdae0 msgr2=0x7f51900fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 shutdown_connections 2026-02-20T02:25:31.336 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:31.333+0000 7f51987a1640 1 -- 10.20.193.106:0/3724963259 wait complete. 2026-02-20T02:25:32.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:31 trial098 ceph-mon[38923]: from='mgr.14162 10.20.193.98:0/2086475479' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-20T02:25:32.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:31 trial098 ceph-mon[38923]: mgrmap e14: trial098.hiicxh(active, since 15s) 2026-02-20T02:25:32.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:31 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/3724963259' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:32.369 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:32.369 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:32.511 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:32.539 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:32.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 -- 10.20.193.106:0/3510588896 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 msgr2=0x7f6fd81049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:32.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 --2- 10.20.193.106:0/3510588896 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 0x7f6fd81049b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0099b0 tx=0x7f6fcc02f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:32.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 -- 10.20.193.106:0/3510588896 shutdown_connections 2026-02-20T02:25:32.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 --2- 10.20.193.106:0/3510588896 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 0x7f6fd81049b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:32.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 -- 10.20.193.106:0/3510588896 >> 10.20.193.106:0/3510588896 conn(0x7f6fd80ffd70 msgr2=0x7f6fd8102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:32.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 -- 10.20.193.106:0/3510588896 shutdown_connections 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 -- 10.20.193.106:0/3510588896 wait complete. 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 Processor -- start 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.647+0000 7f6fdcd06640 1 -- start start 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fdcd06640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 0x7f6fd819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fdcd06640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd810a3f0 con 0x7f6fd81045b0 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fd6575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 0x7f6fd819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fd6575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 0x7f6fd819bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:50710/0 (socket says 10.20.193.106:50710) 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fd6575640 1 -- 10.20.193.106:0/2888742067 learned_addr learned my addr 10.20.193.106:0/2888742067 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:32.649 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fd6575640 1 -- 10.20.193.106:0/2888742067 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd819c050 con 0x7f6fd81045b0 2026-02-20T02:25:32.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fd6575640 1 --2- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 0x7f6fd819bb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc002ac0 tx=0x7f6fcc02fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fbf7fe640 1 -- 10.20.193.106:0/2888742067 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f6fcc047070 con 0x7f6fd81045b0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd819c2e0 con 0x7f6fd81045b0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fbf7fe640 1 -- 10.20.193.106:0/2888742067 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6fcc03e070 con 0x7f6fd81045b0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd819efd0 con 0x7f6fd81045b0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.648+0000 7f6fbf7fe640 1 -- 10.20.193.106:0/2888742067 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f6fcc051060 con 0x7f6fd81045b0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.649+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd810ab90 con 0x7f6fd81045b0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.649+0000 7f6fbf7fe640 1 -- 10.20.193.106:0/2888742067 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 14) ==== 50331+0+0 (secure 0 0 0) 0x7f6fcc038770 con 0x7f6fd81045b0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.649+0000 7f6fbf7fe640 1 --2- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f6fb003dce0 0x7f6fb00401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.649+0000 7f6fbf7fe640 1 -- 10.20.193.106:0/2888742067 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6fcc076bd0 con 0x7f6fd81045b0 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.649+0000 7f6fd5d74640 1 -- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f6fb003dce0 msgr2=0x7f6fb00401a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.98:6800/892283834 2026-02-20T02:25:32.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.649+0000 7f6fd5d74640 1 --2- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f6fb003dce0 0x7f6fb00401a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T02:25:32.653 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.652+0000 7f6fbf7fe640 1 -- 10.20.193.106:0/2888742067 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6fcc034280 con 0x7f6fd81045b0 2026-02-20T02:25:32.769 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.768+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6fd8104a30 con 0x7f6fd81045b0 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fbf7fe640 1 -- 10.20.193.106:0/2888742067 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7f6fd8104a30 con 0x7f6fd81045b0 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f6fb003dce0 msgr2=0x7f6fb00401a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 --2- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f6fb003dce0 0x7f6fb00401a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 msgr2=0x7f6fd819bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 --2- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 0x7f6fd819bb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc002ac0 tx=0x7f6fcc02fec0 comp rx=0 tx=0).stop 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 shutdown_connections 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 --2- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:6800/892283834,v1:10.20.193.98:6801/892283834] conn(0x7f6fb003dce0 0x7f6fb00401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 --2- 10.20.193.106:0/2888742067 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6fd81045b0 0x7f6fd819bb10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 >> 10.20.193.106:0/2888742067 conn(0x7f6fd80ffd70 msgr2=0x7f6fd8100890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:32.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 shutdown_connections 2026-02-20T02:25:32.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:32.769+0000 7f6fdcd06640 1 -- 10.20.193.106:0/2888742067 wait complete. 2026-02-20T02:25:33.091 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:32 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/2888742067' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:33.805 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:33.805 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:33.946 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:33.976 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-20T02:25:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: Active manager daemon trial098.hiicxh restarted 2026-02-20T02:25:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: Activating manager daemon trial098.hiicxh 2026-02-20T02:25:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: osdmap e5: 0 total, 0 up, 0 in 2026-02-20T02:25:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: mgrmap e15: trial098.hiicxh(active, starting, since 0.00260662s) 2026-02-20T02:25:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:25:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr metadata", "who": "trial098.hiicxh", "id": "trial098.hiicxh"}]: dispatch 2026-02-20T02:25:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T02:25:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T02:25:34.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T02:25:34.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: Manager daemon trial098.hiicxh is now available 2026-02-20T02:25:34.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:34.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:34.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:25:34.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial098.hiicxh/mirror_snapshot_schedule"}]: dispatch 2026-02-20T02:25:34.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial098.hiicxh/trash_purge_schedule"}]: dispatch 2026-02-20T02:25:34.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.107+0000 7f05b1360640 1 -- 10.20.193.106:0/61913000 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 msgr2=0x7f05ac1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:34.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.107+0000 7f05b1360640 1 --2- 10.20.193.106:0/61913000 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 0x7f05ac1049e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f05a00099b0 tx=0x7f05a002f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:34.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.107+0000 7f05b1360640 1 -- 10.20.193.106:0/61913000 shutdown_connections 2026-02-20T02:25:34.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.107+0000 7f05b1360640 1 --2- 10.20.193.106:0/61913000 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 0x7f05ac1049e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:34.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.107+0000 7f05b1360640 1 -- 10.20.193.106:0/61913000 >> 10.20.193.106:0/61913000 conn(0x7f05ac0ffd70 msgr2=0x7f05ac1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:34.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.107+0000 7f05b1360640 1 -- 10.20.193.106:0/61913000 shutdown_connections 2026-02-20T02:25:34.111 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.108+0000 7f05b1360640 1 -- 10.20.193.106:0/61913000 wait complete. 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.108+0000 7f05b1360640 1 Processor -- start 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.108+0000 7f05b1360640 1 -- start start 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.108+0000 7f05b1360640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 0x7f05ac19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.108+0000 7f05b1360640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac10a420 con 0x7f05ac1045e0 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.108+0000 7f05aaffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 0x7f05ac19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.108+0000 7f05aaffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 0x7f05ac19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:50726/0 (socket says 10.20.193.106:50726) 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.108+0000 7f05aaffd640 1 -- 10.20.193.106:0/1148977813 learned_addr learned my addr 10.20.193.106:0/1148977813 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.109+0000 7f05aaffd640 1 -- 10.20.193.106:0/1148977813 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac19bfd0 con 0x7f05ac1045e0 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.109+0000 7f05aaffd640 1 --2- 10.20.193.106:0/1148977813 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 0x7f05ac19ba90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f05a002f860 tx=0x7f05a0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.109+0000 7f058bfff640 1 -- 10.20.193.106:0/1148977813 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f05a0004590 con 0x7f05ac1045e0 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.109+0000 7f058bfff640 1 -- 10.20.193.106:0/1148977813 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f05a0046070 con 0x7f05ac1045e0 2026-02-20T02:25:34.112 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.109+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac19c260 con 0x7f05ac1045e0 2026-02-20T02:25:34.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.109+0000 7f058bfff640 1 -- 10.20.193.106:0/1148977813 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f05a00416d0 con 0x7f05ac1045e0 2026-02-20T02:25:34.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.109+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac19ef50 con 0x7f05ac1045e0 2026-02-20T02:25:34.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.110+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac10abc0 con 0x7f05ac1045e0 2026-02-20T02:25:34.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.110+0000 7f058bfff640 1 -- 10.20.193.106:0/1148977813 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 15) ==== 50055+0+0 (secure 0 0 0) 0x7f05a0041990 con 0x7f05ac1045e0 2026-02-20T02:25:34.113 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.110+0000 7f058bfff640 1 -- 10.20.193.106:0/1148977813 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f05a0076f70 con 0x7f05ac1045e0 2026-02-20T02:25:34.114 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.113+0000 7f058bfff640 1 -- 10.20.193.106:0/1148977813 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f05a0034280 con 0x7f05ac1045e0 2026-02-20T02:25:34.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.231+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f05ac194e20 con 0x7f05ac1045e0 2026-02-20T02:25:34.233 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.232+0000 7f058bfff640 1 -- 10.20.193.106:0/1148977813 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7f05a0037e50 con 0x7f05ac1045e0 2026-02-20T02:25:34.233 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:34.233 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:34.233 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:34.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.233+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 msgr2=0x7f05ac19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:34.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.233+0000 7f05b1360640 1 --2- 10.20.193.106:0/1148977813 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 0x7f05ac19ba90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f05a002f860 tx=0x7f05a0004290 comp rx=0 tx=0).stop 2026-02-20T02:25:34.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.233+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 shutdown_connections 2026-02-20T02:25:34.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.233+0000 7f05b1360640 1 --2- 10.20.193.106:0/1148977813 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f05ac1045e0 0x7f05ac19ba90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:34.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.233+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 >> 10.20.193.106:0/1148977813 conn(0x7f05ac0ffd70 msgr2=0x7f05ac100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:34.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.233+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 shutdown_connections 2026-02-20T02:25:34.234 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:34.233+0000 7f05b1360640 1 -- 10.20.193.106:0/1148977813 wait complete. 2026-02-20T02:25:35.289 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:35.289 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:34 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/1148977813' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:34 trial098 ceph-mon[38923]: mgrmap e16: trial098.hiicxh(active, since 1.00337s) 2026-02-20T02:25:35.431 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.conf 2026-02-20T02:25:35.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.565+0000 7fa02cb29640 1 -- 10.20.193.106:0/624757612 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 msgr2=0x7fa0281038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:35.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.565+0000 7fa02cb29640 1 --2- 10.20.193.106:0/624757612 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 0x7fa0281038c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0099b0 tx=0x7fa01c02f340 comp rx=0 tx=0).stop 2026-02-20T02:25:35.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.565+0000 7fa02cb29640 1 -- 10.20.193.106:0/624757612 shutdown_connections 2026-02-20T02:25:35.568 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.565+0000 7fa02cb29640 1 --2- 10.20.193.106:0/624757612 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 0x7fa0281038c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.565+0000 7fa02cb29640 1 -- 10.20.193.106:0/624757612 >> 10.20.193.106:0/624757612 conn(0x7fa0280fcec0 msgr2=0x7fa0280ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.565+0000 7fa02cb29640 1 -- 10.20.193.106:0/624757612 shutdown_connections 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.565+0000 7fa02cb29640 1 -- 10.20.193.106:0/624757612 wait complete. 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.566+0000 7fa02cb29640 1 Processor -- start 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.566+0000 7fa02cb29640 1 -- start start 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.566+0000 7fa02cb29640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 0x7fa02819f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.566+0000 7fa02cb29640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa02810c720 con 0x7fa0281034e0 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.566+0000 7fa026575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 0x7fa02819f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.566+0000 7fa026575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 0x7fa02819f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:50746/0 (socket says 10.20.193.106:50746) 2026-02-20T02:25:35.569 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.566+0000 7fa026575640 1 -- 10.20.193.106:0/280429254 learned_addr learned my addr 10.20.193.106:0/280429254 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:35.570 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.567+0000 7fa026575640 1 -- 10.20.193.106:0/280429254 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02819fe10 con 0x7fa0281034e0 2026-02-20T02:25:35.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.567+0000 7fa026575640 1 --2- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 0x7fa02819f8d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa01c002980 tx=0x7fa01c0029b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:35.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.567+0000 7fa00f7fe640 1 -- 10.20.193.106:0/280429254 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa01c002db0 con 0x7fa0281034e0 2026-02-20T02:25:35.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.567+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0281a00a0 con 0x7fa0281034e0 2026-02-20T02:25:35.571 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.567+0000 7fa00f7fe640 1 -- 10.20.193.106:0/280429254 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa01c046070 con 0x7fa0281034e0 2026-02-20T02:25:35.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.567+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa028199a90 con 0x7fa0281034e0 2026-02-20T02:25:35.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.567+0000 7fa00f7fe640 1 -- 10.20.193.106:0/280429254 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa01c041630 con 0x7fa0281034e0 2026-02-20T02:25:35.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.568+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa02806b2a0 con 0x7fa0281034e0 2026-02-20T02:25:35.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.568+0000 7fa00f7fe640 1 -- 10.20.193.106:0/280429254 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 16) ==== 50182+0+0 (secure 0 0 0) 0x7fa01c038a50 con 0x7fa0281034e0 2026-02-20T02:25:35.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.568+0000 7fa00f7fe640 1 --2- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa00003db20 0x7fa00003ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:35.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.568+0000 7fa00f7fe640 1 -- 10.20.193.106:0/280429254 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa01c076fc0 con 0x7fa0281034e0 2026-02-20T02:25:35.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.569+0000 7fa025d74640 1 --2- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa00003db20 0x7fa00003ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:35.572 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.570+0000 7fa025d74640 1 --2- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa00003db20 0x7fa00003ffe0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa0100099c0 tx=0x7fa010006eb0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:35.573 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.571+0000 7fa00f7fe640 1 -- 10.20.193.106:0/280429254 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa01c035320 con 0x7fa0281034e0 2026-02-20T02:25:35.687 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.686+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa02819afc0 con 0x7fa0281034e0 2026-02-20T02:25:35.688 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.686+0000 7fa00f7fe640 1 -- 10.20.193.106:0/280429254 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7fa01c041da0 con 0x7fa0281034e0 2026-02-20T02:25:35.688 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:35.688 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:35.689 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:35.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa00003db20 msgr2=0x7fa00003ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:35.689 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 --2- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa00003db20 0x7fa00003ffe0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa0100099c0 tx=0x7fa010006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:35.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 msgr2=0x7fa02819f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:35.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 --2- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 0x7fa02819f8d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa01c002980 tx=0x7fa01c0029b0 comp rx=0 tx=0).stop 2026-02-20T02:25:35.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 shutdown_connections 2026-02-20T02:25:35.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 --2- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa00003db20 0x7fa00003ffe0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:35.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 --2- 10.20.193.106:0/280429254 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa0281034e0 0x7fa02819f8d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:35.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 >> 10.20.193.106:0/280429254 conn(0x7fa0280fcec0 msgr2=0x7fa028104290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:35.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 shutdown_connections 2026-02-20T02:25:35.690 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:35.687+0000 7fa02cb29640 1 -- 10.20.193.106:0/280429254 wait complete. 2026-02-20T02:25:36.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:34] ENGINE Bus STARTING 2026-02-20T02:25:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:34] ENGINE Serving on http://10.20.193.98:8765 2026-02-20T02:25:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:34] ENGINE Serving on https://10.20.193.98:7150 2026-02-20T02:25:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:34] ENGINE Bus STARTED 2026-02-20T02:25:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: [20/Feb/2026:02:25:34] ENGINE Client ('10.20.193.98', 37988) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T02:25:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd/host:trial098", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:25:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd/host:trial106", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:36.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial106", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-20T02:25:36.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial106", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-20T02:25:36.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:36.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:35 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/280429254' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:36.727 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:36.728 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:36.879 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.conf 2026-02-20T02:25:36.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.992+0000 7f30a80c5640 1 -- 10.20.193.106:0/3283734592 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 msgr2=0x7f30a0077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:36.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.992+0000 7f30a80c5640 1 --2- 10.20.193.106:0/3283734592 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 0x7f30a0077a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f30900099b0 tx=0x7f309002f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:36.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.992+0000 7f30a80c5640 1 -- 10.20.193.106:0/3283734592 shutdown_connections 2026-02-20T02:25:36.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.992+0000 7f30a80c5640 1 --2- 10.20.193.106:0/3283734592 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 0x7f30a0077a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:36.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.992+0000 7f30a80c5640 1 -- 10.20.193.106:0/3283734592 >> 10.20.193.106:0/3283734592 conn(0x7f30a0100290 msgr2=0x7f30a01026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:36.995 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.992+0000 7f30a80c5640 1 -- 10.20.193.106:0/3283734592 shutdown_connections 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.992+0000 7f30a80c5640 1 -- 10.20.193.106:0/3283734592 wait complete. 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.993+0000 7f30a80c5640 1 Processor -- start 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.993+0000 7f30a80c5640 1 -- start start 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.993+0000 7f30a80c5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 0x7f30a01a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.993+0000 7f30a80c5640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0112e90 con 0x7f30a0077620 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.993+0000 7f30a5e3a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 0x7f30a01a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.993+0000 7f30a5e3a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 0x7f30a01a0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:50766/0 (socket says 10.20.193.106:50766) 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.993+0000 7f30a5e3a640 1 -- 10.20.193.106:0/2270010789 learned_addr learned my addr 10.20.193.106:0/2270010789 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:36.996 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.993+0000 7f30a5e3a640 1 -- 10.20.193.106:0/2270010789 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a01a0880 con 0x7f30a0077620 2026-02-20T02:25:36.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.994+0000 7f30a5e3a640 1 --2- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 0x7f30a01a0340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3090002410 tx=0x7f3090002d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:36.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.994+0000 7f308effd640 1 -- 10.20.193.106:0/2270010789 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f3090047070 con 0x7f30a0077620 2026-02-20T02:25:36.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.994+0000 7f308effd640 1 -- 10.20.193.106:0/2270010789 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f309003e070 con 0x7f30a0077620 2026-02-20T02:25:36.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.994+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a01a0b10 con 0x7f30a0077620 2026-02-20T02:25:36.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.994+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a01a0f70 con 0x7f30a0077620 2026-02-20T02:25:36.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.994+0000 7f308effd640 1 -- 10.20.193.106:0/2270010789 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f30900425b0 con 0x7f30a0077620 2026-02-20T02:25:36.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.994+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a0078d60 con 0x7f30a0077620 2026-02-20T02:25:36.998 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.995+0000 7f308effd640 1 -- 10.20.193.106:0/2270010789 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 17) ==== 50374+0+0 (secure 0 0 0) 0x7f3090004260 con 0x7f30a0077620 2026-02-20T02:25:36.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.995+0000 7f308effd640 1 --2- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f307c03dd80 0x7f307c040240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:36.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.995+0000 7f308effd640 1 -- 10.20.193.106:0/2270010789 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3090076f10 con 0x7f30a0077620 2026-02-20T02:25:36.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.995+0000 7f30a5639640 1 --2- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f307c03dd80 0x7f307c040240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:36.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.996+0000 7f30a5639640 1 --2- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f307c03dd80 0x7f307c040240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f30940099c0 tx=0x7f3094006eb0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:36.999 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:36.998+0000 7f308effd640 1 -- 10.20.193.106:0/2270010789 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3090041e50 con 0x7f30a0077620 2026-02-20T02:25:37.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.119+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f30a01a4c10 con 0x7f30a0077620 2026-02-20T02:25:37.121 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.119+0000 7f308effd640 1 -- 10.20.193.106:0/2270010789 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7f309004be30 con 0x7f30a0077620 2026-02-20T02:25:37.121 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:37.122 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f307c03dd80 msgr2=0x7f307c040240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 --2- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f307c03dd80 0x7f307c040240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f30940099c0 tx=0x7f3094006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 msgr2=0x7f30a01a0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 --2- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 0x7f30a01a0340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3090002410 tx=0x7f3090002d30 comp rx=0 tx=0).stop 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 shutdown_connections 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 --2- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f307c03dd80 0x7f307c040240 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 --2- 10.20.193.106:0/2270010789 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f30a0077620 0x7f30a01a0340 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:37.123 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 >> 10.20.193.106:0/2270010789 conn(0x7f30a0100290 msgr2=0x7f30a0100670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:37.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 shutdown_connections 2026-02-20T02:25:37.124 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:37.120+0000 7f30a80c5640 1 -- 10.20.193.106:0/2270010789 wait complete. 2026-02-20T02:25:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Updating trial098:/etc/ceph/ceph.conf 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Updating trial106:/etc/ceph/ceph.conf 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Updating trial098:/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.conf 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Updating trial106:/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.conf 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Updating trial098:/etc/ceph/ceph.client.admin.keyring 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Updating trial106:/etc/ceph/ceph.client.admin.keyring 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Updating trial098:/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Updating trial106:/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: Deploying daemon ceph-exporter.trial106 on trial106 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: mgrmap e17: trial098.hiicxh(active, since 2s) 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:37.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:37.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:37.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-20T02:25:37.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-20T02:25:37.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:36 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:38.242 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:38.243 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:38.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:37 trial098 ceph-mon[38923]: Deploying daemon crash.trial106 on trial106 2026-02-20T02:25:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:37 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/2270010789' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:37 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:37 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:37 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:37 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:38.471 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.conf 2026-02-20T02:25:38.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.578+0000 7ff627912640 1 -- 10.20.193.106:0/2670132095 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 msgr2=0x7ff62010aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.578+0000 7ff627912640 1 --2- 10.20.193.106:0/2670132095 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 0x7ff62010aa30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6100099b0 tx=0x7ff61002f2b0 comp rx=0 tx=0).stop 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.578+0000 7ff627912640 1 -- 10.20.193.106:0/2670132095 shutdown_connections 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.578+0000 7ff627912640 1 --2- 10.20.193.106:0/2670132095 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 0x7ff62010aa30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.578+0000 7ff627912640 1 -- 10.20.193.106:0/2670132095 >> 10.20.193.106:0/2670132095 conn(0x7ff620100260 msgr2=0x7ff620102680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.578+0000 7ff627912640 1 -- 10.20.193.106:0/2670132095 shutdown_connections 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.578+0000 7ff627912640 1 -- 10.20.193.106:0/2670132095 wait complete. 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.579+0000 7ff627912640 1 Processor -- start 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.579+0000 7ff627912640 1 -- start start 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.579+0000 7ff627912640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 0x7ff62019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:38.583 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.579+0000 7ff627912640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff62010e9a0 con 0x7ff62010a650 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.579+0000 7ff625687640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 0x7ff62019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.579+0000 7ff625687640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 0x7ff62019be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.106:54768/0 (socket says 10.20.193.106:54768) 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.579+0000 7ff625687640 1 -- 10.20.193.106:0/3605535086 learned_addr learned my addr 10.20.193.106:0/3605535086 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.579+0000 7ff625687640 1 -- 10.20.193.106:0/3605535086 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62019c390 con 0x7ff62010a650 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.580+0000 7ff625687640 1 --2- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 0x7ff62019be50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff610002410 tx=0x7ff610002d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.580+0000 7ff60e7fc640 1 -- 10.20.193.106:0/3605535086 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff610047070 con 0x7ff62010a650 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.580+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62019c620 con 0x7ff62010a650 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.580+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6201a0720 con 0x7ff62010a650 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.580+0000 7ff60e7fc640 1 -- 10.20.193.106:0/3605535086 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff61003e070 con 0x7ff62010a650 2026-02-20T02:25:38.584 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.580+0000 7ff60e7fc640 1 -- 10.20.193.106:0/3605535086 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff610038df0 con 0x7ff62010a650 2026-02-20T02:25:38.585 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.580+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff620105cc0 con 0x7ff62010a650 2026-02-20T02:25:38.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.580+0000 7ff60e7fc640 1 -- 10.20.193.106:0/3605535086 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 17) ==== 50374+0+0 (secure 0 0 0) 0x7ff610004260 con 0x7ff62010a650 2026-02-20T02:25:38.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.581+0000 7ff60e7fc640 1 --2- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ff5fc03ddd0 0x7ff5fc040290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:38.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.581+0000 7ff60e7fc640 1 -- 10.20.193.106:0/3605535086 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff610076d60 con 0x7ff62010a650 2026-02-20T02:25:38.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.581+0000 7ff624e86640 1 --2- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ff5fc03ddd0 0x7ff5fc040290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:38.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.581+0000 7ff624e86640 1 --2- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ff5fc03ddd0 0x7ff5fc040290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6140099c0 tx=0x7ff614006eb0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:38.586 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.583+0000 7ff60e7fc640 1 -- 10.20.193.106:0/3605535086 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff610038770 con 0x7ff62010a650 2026-02-20T02:25:38.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.701+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff62019d1b0 con 0x7ff62010a650 2026-02-20T02:25:38.704 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.701+0000 7ff60e7fc640 1 -- 10.20.193.106:0/3605535086 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+748 (secure 0 0 0) 0x7ff610042d00 con 0x7ff62010a650 2026-02-20T02:25:38.704 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:38.704 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":1,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:24:55.178003Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T02:25:38.705 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 1 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ff5fc03ddd0 msgr2=0x7ff5fc040290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 --2- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ff5fc03ddd0 0x7ff5fc040290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6140099c0 tx=0x7ff614006eb0 comp rx=0 tx=0).stop 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 msgr2=0x7ff62019be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 --2- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 0x7ff62019be50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff610002410 tx=0x7ff610002d30 comp rx=0 tx=0).stop 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 shutdown_connections 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 --2- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ff5fc03ddd0 0x7ff5fc040290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 --2- 10.20.193.106:0/3605535086 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ff62010a650 0x7ff62019be50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 >> 10.20.193.106:0/3605535086 conn(0x7ff620100260 msgr2=0x7ff620100640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:38.706 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 shutdown_connections 2026-02-20T02:25:38.707 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:38.703+0000 7ff627912640 1 -- 10.20.193.106:0/3605535086 wait complete. 2026-02-20T02:25:39.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: Deploying daemon node-exporter.trial106 on trial106 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial106.gehstk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.trial106.gehstk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:38 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/3605535086' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:39.744 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-20T02:25:39.744 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T02:25:39.923 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:25:40.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:39 trial098 ceph-mon[38923]: Deploying daemon mgr.trial106.gehstk on trial106 2026-02-20T02:25:40.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:40.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:40.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:40.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:40.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T02:25:40.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:25:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:25:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: mon.trial098 calling monitor election 2026-02-20T02:25:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:25:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.? 10.20.193.106:0/3014501775' entity='mgr.trial106.gehstk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/trial106.gehstk/crt"}]: dispatch 2026-02-20T02:25:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: mon.trial106 calling monitor election 2026-02-20T02:25:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: mon.trial098 is new leader, mons trial098,trial106 in quorum (ranks 0,1) 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: monmap epoch 2 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: last_changed 2026-02-20T02:25:39.961633+0000 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: created 2026-02-20T02:24:55.178003+0000 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: min_mon_release 19 (squid) 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: election_strategy: 1 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: 0: [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] mon.trial098 2026-02-20T02:25:45.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: 1: [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] mon.trial106 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: fsmap 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: osdmap e5: 0 total, 0 up, 0 in 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: mgrmap e17: trial098.hiicxh(active, since 11s) 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: overall HEALTH_OK 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: Standby manager daemon trial106.gehstk started 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.? 10.20.193.106:0/3014501775' entity='mgr.trial106.gehstk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.? 10.20.193.106:0/3014501775' entity='mgr.trial106.gehstk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/trial106.gehstk/key"}]: dispatch 2026-02-20T02:25:45.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:45 trial098 ceph-mon[38923]: from='mgr.? 10.20.193.106:0/3014501775' entity='mgr.trial106.gehstk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.034+0000 7ffbd95a6640 1 -- 10.20.193.106:0/3212820323 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 msgr2=0x7ffbb8008780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.034+0000 7ffbd95a6640 1 --2- 10.20.193.106:0/3212820323 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 0x7ffbb8008780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffbd41057b0 tx=0x7ffbc8030cd0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.034+0000 7ffbd95a6640 1 -- 10.20.193.106:0/3212820323 shutdown_connections 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.034+0000 7ffbd95a6640 1 --2- 10.20.193.106:0/3212820323 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 0x7ffbb8008780 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.034+0000 7ffbd95a6640 1 -- 10.20.193.106:0/3212820323 >> 10.20.193.106:0/3212820323 conn(0x7ffbd41006d0 msgr2=0x7ffbd4102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd95a6640 1 -- 10.20.193.106:0/3212820323 shutdown_connections 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd95a6640 1 -- 10.20.193.106:0/3212820323 wait complete. 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd95a6640 1 Processor -- start 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd95a6640 1 -- start start 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd95a6640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 0x7ffbd419c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd95a6640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 0x7ffbd41a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd95a6640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd410c450 con 0x7ffbb8006310 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd95a6640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd410c2d0 con 0x7ffbd419c5a0 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd27fc640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 0x7ffbd41a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd27fc640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 0x7ffbd41a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.106:3300/0 says I am v2:10.20.193.106:35264/0 (socket says 10.20.193.106:35264) 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd27fc640 1 -- 10.20.193.106:0/2106865914 learned_addr learned my addr 10.20.193.106:0/2106865914 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd2ffd640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 0x7ffbd419c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd27fc640 1 -- 10.20.193.106:0/2106865914 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 msgr2=0x7ffbd41a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd27fc640 1 -- 10.20.193.106:0/2106865914 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 msgr2=0x7ffbd41a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.035+0000 7ffbd27fc640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 0x7ffbd41a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-20T02:25:46.038 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbd27fc640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 0x7ffbd41a0930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbd2ffd640 1 -- 10.20.193.106:0/2106865914 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 msgr2=0x7ffbd41a0930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbd2ffd640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 0x7ffbd41a0930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbd2ffd640 1 -- 10.20.193.106:0/2106865914 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd419cc50 con 0x7ffbb8006310 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbd2ffd640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 0x7ffbd419c060 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8002410 tx=0x7ffbc8032820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbb3fff640 1 -- 10.20.193.106:0/2106865914 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ffbc8047070 con 0x7ffbb8006310 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbb3fff640 1 -- 10.20.193.106:0/2106865914 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ffbc8043460 con 0x7ffbb8006310 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd41a0e70 con 0x7ffbb8006310 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbb3fff640 1 -- 10.20.193.106:0/2106865914 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ffbc80425e0 con 0x7ffbb8006310 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.036+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd41a1400 con 0x7ffbb8006310 2026-02-20T02:25:46.039 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.037+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd4105d80 con 0x7ffbb8006310 2026-02-20T02:25:46.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.037+0000 7ffbb3fff640 1 -- 10.20.193.106:0/2106865914 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 18) ==== 100061+0+0 (secure 0 0 0) 0x7ffbc800f040 con 0x7ffbb8006310 2026-02-20T02:25:46.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.037+0000 7ffbb3fff640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ffba8077510 0x7ffba80799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:46.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.038+0000 7ffbb3fff640 1 -- 10.20.193.106:0/2106865914 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ffbc80bf200 con 0x7ffbb8006310 2026-02-20T02:25:46.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.038+0000 7ffbd27fc640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ffba8077510 0x7ffba80799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:46.040 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.038+0000 7ffbd27fc640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ffba8077510 0x7ffba80799d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc006fd0 tx=0x7ffbbc008040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:46.042 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.040+0000 7ffbb3fff640 1 -- 10.20.193.106:0/2106865914 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ffbc808d410 con 0x7ffbb8006310 2026-02-20T02:25:46.121 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: mgrmap e18: trial098.hiicxh(active, since 11s), standbys: trial106.gehstk 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr metadata", "who": "trial106.gehstk", "id": "trial106.gehstk"}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: Updating trial098:/etc/ceph/ceph.conf 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: Updating trial106:/etc/ceph/ceph.conf 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: Updating trial098:/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.conf 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: Updating trial106:/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/config/ceph.conf 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: Reconfiguring mon.trial098 (unknown last config time)... 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: Reconfiguring daemon mon.trial098 on trial098 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial098.hiicxh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:46.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:46 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:25:46.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.158+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ffbd41a1710 con 0x7ffbb8006310 2026-02-20T02:25:46.160 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.158+0000 7ffbb3fff640 1 -- 10.20.193.106:0/2106865914 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1025 (secure 0 0 0) 0x7ffbc80922c0 con 0x7ffbb8006310 2026-02-20T02:25:46.160 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:25:46.160 INFO:teuthology.orchestra.run.trial106.stdout:{"epoch":2,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","modified":"2026-02-20T02:25:39.961633Z","created":"2026-02-20T02:24:55.178003Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial098","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:3300","nonce":0},{"type":"v1","addr":"10.20.193.98:6789","nonce":0}]},"addr":"10.20.193.98:6789/0","public_addr":"10.20.193.98:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"trial106","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:3300","nonce":0},{"type":"v1","addr":"10.20.193.106:6789","nonce":0}]},"addr":"10.20.193.106:6789/0","public_addr":"10.20.193.106:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-02-20T02:25:46.160 INFO:teuthology.orchestra.run.trial106.stderr:dumped monmap epoch 2 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ffba8077510 msgr2=0x7ffba80799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ffba8077510 0x7ffba80799d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc006fd0 tx=0x7ffbbc008040 comp rx=0 tx=0).stop 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 msgr2=0x7ffbd419c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 0x7ffbd419c060 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8002410 tx=0x7ffbc8032820 comp rx=0 tx=0).stop 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 shutdown_connections 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7ffba8077510 0x7ffba80799d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7ffbd419c5a0 0x7ffbd41a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 --2- 10.20.193.106:0/2106865914 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7ffbb8006310 0x7ffbd419c060 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 >> 10.20.193.106:0/2106865914 conn(0x7ffbd41006d0 msgr2=0x7ffbd4109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 shutdown_connections 2026-02-20T02:25:46.161 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:25:46.159+0000 7ffbd95a6640 1 -- 10.20.193.106:0/2106865914 wait complete. 2026-02-20T02:25:46.197 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-20T02:25:46.197 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-20T02:25:46.357 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.447+0000 7f28b6e74640 1 -- 10.20.193.98:0/1132576795 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b01046f0 msgr2=0x7f28b0104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.447+0000 7f28b6e74640 1 --2- 10.20.193.98:0/1132576795 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b01046f0 0x7f28b0104b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28a40099b0 tx=0x7f28a402f220 comp rx=0 tx=0).stop 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 -- 10.20.193.98:0/1132576795 shutdown_connections 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 --2- 10.20.193.98:0/1132576795 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b01046f0 0x7f28b0104b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 --2- 10.20.193.98:0/1132576795 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f28b010a6f0 0x7f28b010aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 -- 10.20.193.98:0/1132576795 >> 10.20.193.98:0/1132576795 conn(0x7f28b01003d0 msgr2=0x7f28b01027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 -- 10.20.193.98:0/1132576795 shutdown_connections 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 -- 10.20.193.98:0/1132576795 wait complete. 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 Processor -- start 2026-02-20T02:25:46.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 -- start start 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f28b01046f0 0x7f28b019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b010a6f0 0x7f28b019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0111910 con 0x7f28b010a6f0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b6e74640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0111790 con 0x7f28b01046f0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b5671640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b010a6f0 0x7f28b019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b5671640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b010a6f0 0x7f28b019cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:57270/0 (socket says 10.20.193.98:57270) 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b5671640 1 -- 10.20.193.98:0/1073544365 learned_addr learned my addr 10.20.193.98:0/1073544365 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b5e72640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f28b01046f0 0x7f28b019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b5671640 1 -- 10.20.193.98:0/1073544365 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f28b01046f0 msgr2=0x7f28b019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.448+0000 7f28b5671640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f28b01046f0 0x7f28b019c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.449+0000 7f28b5671640 1 -- 10.20.193.98:0/1073544365 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b01a0f00 con 0x7f28b010a6f0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.449+0000 7f28b5671640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b010a6f0 0x7f28b019cb70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009980 tx=0x7f28a402fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.449+0000 7f289effd640 1 -- 10.20.193.98:0/1073544365 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f28a4004420 con 0x7f28b010a6f0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.449+0000 7f289effd640 1 -- 10.20.193.98:0/1073544365 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f28a4038a40 con 0x7f28b010a6f0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.449+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b01a1190 con 0x7f28b010a6f0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.449+0000 7f289effd640 1 -- 10.20.193.98:0/1073544365 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f28a40417e0 con 0x7f28b010a6f0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.449+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b01a16c0 con 0x7f28b010a6f0 2026-02-20T02:25:46.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.449+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b0105e30 con 0x7f28b010a6f0 2026-02-20T02:25:46.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.450+0000 7f289effd640 1 -- 10.20.193.98:0/1073544365 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 18) ==== 100061+0+0 (secure 0 0 0) 0x7f28a4038bf0 con 0x7f28b010a6f0 2026-02-20T02:25:46.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.451+0000 7f289effd640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f288c077510 0x7f288c0799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:46.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.451+0000 7f28b5e72640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f288c077510 0x7f288c0799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:46.453 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.451+0000 7f289effd640 1 -- 10.20.193.98:0/1073544365 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f28a403e070 con 0x7f28b010a6f0 2026-02-20T02:25:46.453 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.451+0000 7f28b5e72640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f288c077510 0x7f288c0799d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28a0005fd0 tx=0x7f28a0004380 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:46.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.453+0000 7f289effd640 1 -- 10.20.193.98:0/1073544365 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f28a408b770 con 0x7f28b010a6f0 2026-02-20T02:25:46.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.538+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f28b01a1970 con 0x7f28b010a6f0 2026-02-20T02:25:46.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.538+0000 7f289effd640 1 -- 10.20.193.98:0/1073544365 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) ==== 76+0+225 (secure 0 0 0) 0x7f28a4090620 con 0x7f28b010a6f0 2026-02-20T02:25:46.540 INFO:teuthology.orchestra.run.trial098.stdout:# minimal ceph.conf for 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:25:46.540 INFO:teuthology.orchestra.run.trial098.stdout:[global] 2026-02-20T02:25:46.540 INFO:teuthology.orchestra.run.trial098.stdout: fsid = 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:25:46.540 INFO:teuthology.orchestra.run.trial098.stdout: mon_host = [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] 2026-02-20T02:25:46.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f288c077510 msgr2=0x7f288c0799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:46.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f288c077510 0x7f288c0799d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28a0005fd0 tx=0x7f28a0004380 comp rx=0 tx=0).stop 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b010a6f0 msgr2=0x7f28b019cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b010a6f0 0x7f28b019cb70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009980 tx=0x7f28a402fdf0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 shutdown_connections 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f288c077510 0x7f288c0799d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f28b010a6f0 0x7f28b019cb70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 --2- 10.20.193.98:0/1073544365 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f28b01046f0 0x7f28b019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 >> 10.20.193.98:0/1073544365 conn(0x7f28b01003d0 msgr2=0x7f28b0101080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 shutdown_connections 2026-02-20T02:25:46.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:46.539+0000 7f28b6e74640 1 -- 10.20.193.98:0/1073544365 wait complete. 2026-02-20T02:25:46.578 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-20T02:25:46.578 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:25:46.578 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/etc/ceph/ceph.conf 2026-02-20T02:25:46.604 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:25:46.604 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T02:25:46.671 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:25:46.671 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/ceph/ceph.conf 2026-02-20T02:25:46.700 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:25:46.701 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T02:25:46.764 INFO:tasks.cephadm:Deploying OSDs... 2026-02-20T02:25:46.764 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:25:46.764 DEBUG:teuthology.orchestra.run.trial098:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T02:25:46.779 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T02:25:46.780 DEBUG:teuthology.orchestra.run.trial098:> stat /dev/vg_nvme/lv_1 2026-02-20T02:25:46.835 INFO:teuthology.orchestra.run.trial098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T02:25:46.835 INFO:teuthology.orchestra.run.trial098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T02:25:46.835 INFO:teuthology.orchestra.run.trial098.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-20T02:25:46.835 INFO:teuthology.orchestra.run.trial098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:25:46.835 INFO:teuthology.orchestra.run.trial098.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T02:25:46.835 INFO:teuthology.orchestra.run.trial098.stdout:Access: 2026-02-20 02:25:29.617005302 +0000 2026-02-20T02:25:46.836 INFO:teuthology.orchestra.run.trial098.stdout:Modify: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:46.836 INFO:teuthology.orchestra.run.trial098.stdout:Change: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:46.836 INFO:teuthology.orchestra.run.trial098.stdout: Birth: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:46.836 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T02:25:46.901 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records in 2026-02-20T02:25:46.901 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records out 2026-02-20T02:25:46.901 INFO:teuthology.orchestra.run.trial098.stderr:512 bytes copied, 0.000185884 s, 2.8 MB/s 2026-02-20T02:25:46.902 DEBUG:teuthology.orchestra.run.trial098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T02:25:46.960 DEBUG:teuthology.orchestra.run.trial098:> stat /dev/vg_nvme/lv_2 2026-02-20T02:25:47.018 INFO:teuthology.orchestra.run.trial098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T02:25:47.019 INFO:teuthology.orchestra.run.trial098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T02:25:47.019 INFO:teuthology.orchestra.run.trial098.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-20T02:25:47.019 INFO:teuthology.orchestra.run.trial098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:25:47.019 INFO:teuthology.orchestra.run.trial098.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T02:25:47.019 INFO:teuthology.orchestra.run.trial098.stdout:Access: 2026-02-20 02:25:29.617005302 +0000 2026-02-20T02:25:47.019 INFO:teuthology.orchestra.run.trial098.stdout:Modify: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.019 INFO:teuthology.orchestra.run.trial098.stdout:Change: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.019 INFO:teuthology.orchestra.run.trial098.stdout: Birth: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.020 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T02:25:47.086 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records in 2026-02-20T02:25:47.086 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records out 2026-02-20T02:25:47.086 INFO:teuthology.orchestra.run.trial098.stderr:512 bytes copied, 0.000154086 s, 3.3 MB/s 2026-02-20T02:25:47.087 DEBUG:teuthology.orchestra.run.trial098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T02:25:47.145 DEBUG:teuthology.orchestra.run.trial098:> stat /dev/vg_nvme/lv_3 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: Reconfiguring mgr.trial098.hiicxh (unknown last config time)... 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: Reconfiguring daemon mgr.trial098.hiicxh on trial098 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/2106865914' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: Reconfiguring ceph-exporter.trial098 (monmap changed)... 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: Reconfiguring daemon ceph-exporter.trial098 on trial098 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: Reconfiguring crash.trial098 (monmap changed)... 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: Reconfiguring daemon crash.trial098 on trial098 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1073544365' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:47.148 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: Reconfiguring alertmanager.trial098 (dependencies changed)... 2026-02-20T02:25:47.149 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:47 trial098 ceph-mon[38923]: Reconfiguring daemon alertmanager.trial098 on trial098 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout:Access: 2026-02-20 02:25:29.617005302 +0000 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout:Modify: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout:Change: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.165 INFO:teuthology.orchestra.run.trial098.stdout: Birth: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.165 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T02:25:47.231 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records in 2026-02-20T02:25:47.231 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records out 2026-02-20T02:25:47.231 INFO:teuthology.orchestra.run.trial098.stderr:512 bytes copied, 0.000313231 s, 1.6 MB/s 2026-02-20T02:25:47.232 DEBUG:teuthology.orchestra.run.trial098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T02:25:47.289 DEBUG:teuthology.orchestra.run.trial098:> stat /dev/vg_nvme/lv_4 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout:Access: 2026-02-20 02:25:29.617005302 +0000 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout:Modify: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout:Change: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.346 INFO:teuthology.orchestra.run.trial098.stdout: Birth: 2026-02-20 02:23:59.900270315 +0000 2026-02-20T02:25:47.346 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T02:25:47.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:47 trial106 ceph-mon[44052]: Reconfiguring daemon alertmanager.trial098 on trial098 2026-02-20T02:25:47.410 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records in 2026-02-20T02:25:47.410 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records out 2026-02-20T02:25:47.410 INFO:teuthology.orchestra.run.trial098.stderr:512 bytes copied, 0.000227572 s, 2.2 MB/s 2026-02-20T02:25:47.411 DEBUG:teuthology.orchestra.run.trial098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T02:25:47.469 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:25:47.470 DEBUG:teuthology.orchestra.run.trial106:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T02:25:47.488 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T02:25:47.488 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_1 2026-02-20T02:25:47.545 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T02:25:47.545 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T02:25:47.545 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-20T02:25:47.545 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:25:47.546 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T02:25:47.546 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-20 02:25:39.743951054 +0000 2026-02-20T02:25:47.546 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-20 02:24:06.091278461 +0000 2026-02-20T02:25:47.546 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-20 02:24:06.091278461 +0000 2026-02-20T02:25:47.546 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-20 02:24:06.091278461 +0000 2026-02-20T02:25:47.546 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T02:25:47.608 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-20T02:25:47.608 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-20T02:25:47.608 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000150599 s, 3.4 MB/s 2026-02-20T02:25:47.609 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T02:25:47.666 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_2 2026-02-20T02:25:47.724 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T02:25:47.724 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T02:25:47.724 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1320 Links: 1 2026-02-20T02:25:47.725 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:25:47.725 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T02:25:47.725 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-20 02:25:39.743951054 +0000 2026-02-20T02:25:47.725 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-20 02:24:06.092278429 +0000 2026-02-20T02:25:47.725 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-20 02:24:06.092278429 +0000 2026-02-20T02:25:47.725 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-20 02:24:06.092278429 +0000 2026-02-20T02:25:47.725 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T02:25:47.789 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-20T02:25:47.789 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-20T02:25:47.789 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000142905 s, 3.6 MB/s 2026-02-20T02:25:47.791 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T02:25:47.848 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_3 2026-02-20T02:25:47.904 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T02:25:47.904 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T02:25:47.905 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-20T02:25:47.905 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:25:47.905 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T02:25:47.905 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-20 02:25:39.744951017 +0000 2026-02-20T02:25:47.905 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-20 02:24:06.090278495 +0000 2026-02-20T02:25:47.905 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-20 02:24:06.090278495 +0000 2026-02-20T02:25:47.905 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-20 02:24:06.090278495 +0000 2026-02-20T02:25:47.905 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T02:25:47.969 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-20T02:25:47.969 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-20T02:25:47.969 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000155258 s, 3.3 MB/s 2026-02-20T02:25:47.970 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T02:25:48.027 DEBUG:teuthology.orchestra.run.trial106:> stat /dev/vg_nvme/lv_4 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout:Access: 2026-02-20 02:25:39.744951017 +0000 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-20 02:24:06.090278495 +0000 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-20 02:24:06.090278495 +0000 2026-02-20T02:25:48.084 INFO:teuthology.orchestra.run.trial106.stdout: Birth: 2026-02-20 02:24:06.090278495 +0000 2026-02-20T02:25:48.084 DEBUG:teuthology.orchestra.run.trial106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T02:25:48.147 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records in 2026-02-20T02:25:48.147 INFO:teuthology.orchestra.run.trial106.stderr:1+0 records out 2026-02-20T02:25:48.147 INFO:teuthology.orchestra.run.trial106.stderr:512 bytes copied, 0.000144067 s, 3.6 MB/s 2026-02-20T02:25:48.148 DEBUG:teuthology.orchestra.run.trial106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T02:25:48.204 INFO:tasks.cephadm:Deploying osd.0 on trial098 with /dev/vg_nvme/lv_4... 2026-02-20T02:25:48.205 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-20T02:25:48.371 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:48.377 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:48.377 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:48.377 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:48 trial098 ceph-mon[38923]: Reconfiguring grafana.trial098 (dependencies changed)... 2026-02-20T02:25:48.377 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:48 trial098 ceph-mon[38923]: Reconfiguring daemon grafana.trial098 on trial098 2026-02-20T02:25:48.377 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:48.378 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:48.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:48.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:48.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:48 trial106 ceph-mon[44052]: Reconfiguring grafana.trial098 (dependencies changed)... 2026-02-20T02:25:48.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:48 trial106 ceph-mon[44052]: Reconfiguring daemon grafana.trial098 on trial098 2026-02-20T02:25:48.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:48.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.422 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: Reconfiguring prometheus.trial098 (dependencies changed)... 2026-02-20T02:25:49.423 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: Reconfiguring daemon prometheus.trial098 on trial098 2026-02-20T02:25:49.423 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:25:49.423 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.423 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.423 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: Reconfiguring ceph-exporter.trial106 (monmap changed)... 2026-02-20T02:25:49.423 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial106", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-20T02:25:49.423 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: Reconfiguring daemon ceph-exporter.trial106 on trial106 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial106.gehstk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T02:25:49.424 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:49.454 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:49.469 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch daemon add osd trial098:vg_nvme/lv_4 2026-02-20T02:25:49.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: Reconfiguring prometheus.trial098 (dependencies changed)... 2026-02-20T02:25:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: Reconfiguring daemon prometheus.trial098 on trial098 2026-02-20T02:25:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:25:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: Reconfiguring ceph-exporter.trial106 (monmap changed)... 2026-02-20T02:25:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial106", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-20T02:25:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: Reconfiguring daemon ceph-exporter.trial106 on trial106 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial106.gehstk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T02:25:49.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:49.623 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:49.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 -- 10.20.193.98:0/555649962 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 msgr2=0x7f10a0104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:49.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 --2- 10.20.193.98:0/555649962 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 0x7f10a0104d20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f10940099b0 tx=0x7f109402f220 comp rx=0 tx=0).stop 2026-02-20T02:25:49.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 -- 10.20.193.98:0/555649962 shutdown_connections 2026-02-20T02:25:49.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 --2- 10.20.193.98:0/555649962 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f10a0105b20 0x7f10a0105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:49.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 --2- 10.20.193.98:0/555649962 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 0x7f10a0104d20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:49.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 -- 10.20.193.98:0/555649962 >> 10.20.193.98:0/555649962 conn(0x7f10a01000b0 msgr2=0x7f10a01024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:49.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 -- 10.20.193.98:0/555649962 shutdown_connections 2026-02-20T02:25:49.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 -- 10.20.193.98:0/555649962 wait complete. 2026-02-20T02:25:49.735 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 Processor -- start 2026-02-20T02:25:49.735 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 -- start start 2026-02-20T02:25:49.735 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 0x7f10a019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:49.735 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f10a0105b20 0x7f10a019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:49.735 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10a010d4d0 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.732+0000 7f10a5a03640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f10a010d350 con 0x7f10a0105b20 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f109effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 0x7f10a019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f109effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 0x7f10a019c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44266/0 (socket says 10.20.193.98:44266) 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f109effd640 1 -- 10.20.193.98:0/3740484409 learned_addr learned my addr 10.20.193.98:0/3740484409 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f109effd640 1 -- 10.20.193.98:0/3740484409 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f10a0105b20 msgr2=0x7f10a019c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f109effd640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f10a0105b20 0x7f10a019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f109effd640 1 -- 10.20.193.98:0/3740484409 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a019cf60 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f109effd640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 0x7f10a019c3a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1094005e90 tx=0x7f1094004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f10a4a01640 1 -- 10.20.193.98:0/3740484409 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1094046070 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f10a4a01640 1 -- 10.20.193.98:0/3740484409 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1094038a40 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a01a1940 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f10a4a01640 1 -- 10.20.193.98:0/3740484409 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1094041960 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a01a1f50 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.733+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a0104d20 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.734+0000 7f10a4a01640 1 -- 10.20.193.98:0/3740484409 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 18) ==== 100061+0+0 (secure 0 0 0) 0x7f1094038bf0 con 0x7f10a0104920 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.734+0000 7f10a4a01640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1074077510 0x7f10740799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.734+0000 7f109e7fc640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1074077510 0x7f10740799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:49.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.734+0000 7f10a4a01640 1 -- 10.20.193.98:0/3740484409 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f109403e070 con 0x7f10a0104920 2026-02-20T02:25:49.737 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.735+0000 7f109e7fc640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1074077510 0x7f10740799d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f10a019d850 tx=0x7f1088005cf0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:49.739 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.737+0000 7f10a4a01640 1 -- 10.20.193.98:0/3740484409 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f109408b480 con 0x7f10a0104920 2026-02-20T02:25:49.832 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:49.830+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f10a010a470 con 0x7f1074077510 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: Reconfiguring crash.trial106 (monmap changed)... 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: Reconfiguring daemon crash.trial106 on trial106 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: Reconfiguring mgr.trial106.gehstk (monmap changed)... 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: Reconfiguring daemon mgr.trial106.gehstk on trial106 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: Reconfiguring mon.trial106 (monmap changed)... 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: Reconfiguring daemon mon.trial106 on trial106 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial098:9093"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial098:9093"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial098:3000"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial098:3000"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial098:9095"}]: dispatch 2026-02-20T02:25:50.745 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial098:9095"}]: dispatch 2026-02-20T02:25:50.746 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.746 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:50.746 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:50.746 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:25:50.746 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:25:50.746 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:50.746 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.746 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: Reconfiguring crash.trial106 (monmap changed)... 2026-02-20T02:25:50.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: Reconfiguring daemon crash.trial106 on trial106 2026-02-20T02:25:50.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: Reconfiguring mgr.trial106.gehstk (monmap changed)... 2026-02-20T02:25:50.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: Reconfiguring daemon mgr.trial106.gehstk on trial106 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: Reconfiguring mon.trial106 (monmap changed)... 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: Reconfiguring daemon mon.trial106 on trial106 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial098:9093"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial098:9093"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial098:3000"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial098:3000"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial098:9095"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial098:9095"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:50.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:51.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4136969268' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69983772-bfd2-47c6-858b-c78a6ba6bbdf"}]: dispatch 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4136969268' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69983772-bfd2-47c6-858b-c78a6ba6bbdf"}]': finished 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: osdmap e6: 1 total, 0 up, 1 in 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:51.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:51 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/686118597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:25:51.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4136969268' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69983772-bfd2-47c6-858b-c78a6ba6bbdf"}]: dispatch 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4136969268' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69983772-bfd2-47c6-858b-c78a6ba6bbdf"}]': finished 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: osdmap e6: 1 total, 0 up, 1 in 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:51.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:51 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/686118597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:25:54.636 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:54 trial098 ceph-mon[38923]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:25:54.636 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:54 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-20T02:25:54.636 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:54 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:54.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:54 trial106 ceph-mon[44052]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:25:54.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:54 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-20T02:25:54.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:54 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:55.779 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:55 trial098 ceph-mon[38923]: Deploying daemon osd.0 on trial098 2026-02-20T02:25:55.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:55 trial106 ceph-mon[44052]: Deploying daemon osd.0 on trial098 2026-02-20T02:25:56.757 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:56 trial098 ceph-mon[38923]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:25:56.758 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:56 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:56.758 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:56 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:56.758 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:56 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:56 trial106 ceph-mon[44052]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:25:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:56 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:56 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:56 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.291 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.288+0000 7f10a4a01640 1 -- 10.20.193.98:0/3740484409 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f10a010a470 con 0x7f1074077510 2026-02-20T02:25:57.291 INFO:teuthology.orchestra.run.trial098.stdout:Created osd(s) 0 on host 'trial098' 2026-02-20T02:25:57.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1074077510 msgr2=0x7f10740799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:57.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1074077510 0x7f10740799d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f10a019d850 tx=0x7f1088005cf0 comp rx=0 tx=0).stop 2026-02-20T02:25:57.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 msgr2=0x7f10a019c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:57.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 0x7f10a019c3a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1094005e90 tx=0x7f1094004060 comp rx=0 tx=0).stop 2026-02-20T02:25:57.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 shutdown_connections 2026-02-20T02:25:57.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1074077510 0x7f10740799d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:57.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f10a0105b20 0x7f10a019c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:57.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 --2- 10.20.193.98:0/3740484409 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f10a0104920 0x7f10a019c3a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:57.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 >> 10.20.193.98:0/3740484409 conn(0x7f10a01000b0 msgr2=0x7f10a0108d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:57.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 shutdown_connections 2026-02-20T02:25:57.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:57.291+0000 7f10a5a03640 1 -- 10.20.193.98:0/3740484409 wait complete. 2026-02-20T02:25:57.330 DEBUG:teuthology.orchestra.run.trial098:osd.0> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.0.service 2026-02-20T02:25:57.333 INFO:tasks.cephadm:Deploying osd.1 on trial098 with /dev/vg_nvme/lv_3... 2026-02-20T02:25:57.333 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-20T02:25:57.622 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:57.862 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.863 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:57.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:58.397 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:25:58 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0[57082]: 2026-02-20T02:25:58.147+0000 7f291a900740 -1 Falling back to public interface 2026-02-20T02:25:58.438 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:25:58.455 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch daemon add osd trial098:vg_nvme/lv_3 2026-02-20T02:25:58.611 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:25:58.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 -- 10.20.193.98:0/3895919393 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 msgr2=0x7f170c105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:58.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 --2- 10.20.193.98:0/3895919393 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 0x7f170c105fa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0099b0 tx=0x7f16fc02f220 comp rx=0 tx=0).stop 2026-02-20T02:25:58.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 -- 10.20.193.98:0/3895919393 shutdown_connections 2026-02-20T02:25:58.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 --2- 10.20.193.98:0/3895919393 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 0x7f170c105fa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:58.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 --2- 10.20.193.98:0/3895919393 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f170c104920 0x7f170c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:58.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 -- 10.20.193.98:0/3895919393 >> 10.20.193.98:0/3895919393 conn(0x7f170c1000b0 msgr2=0x7f170c1024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 -- 10.20.193.98:0/3895919393 shutdown_connections 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 -- 10.20.193.98:0/3895919393 wait complete. 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 Processor -- start 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 -- start start 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f170c104920 0x7f170c19c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 0x7f170c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f170c10d4b0 con 0x7f170c105b20 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f1712046640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f170c10d330 con 0x7f170c104920 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f170affd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 0x7f170c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f170affd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 0x7f170c19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:34426/0 (socket says 10.20.193.98:34426) 2026-02-20T02:25:58.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f170affd640 1 -- 10.20.193.98:0/2571819213 learned_addr learned my addr 10.20.193.98:0/2571819213 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.717+0000 7f170b7fe640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f170c104920 0x7f170c19c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f170affd640 1 -- 10.20.193.98:0/2571819213 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f170c104920 msgr2=0x7f170c19c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f170affd640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f170c104920 0x7f170c19c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f170affd640 1 -- 10.20.193.98:0/2571819213 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c19ce80 con 0x7f170c105b20 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f170b7fe640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f170c104920 0x7f170c19c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f170affd640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 0x7f170c19c890 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009ae0 tx=0x7f16fc004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f1708ff9640 1 -- 10.20.193.98:0/2571819213 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f16fc046070 con 0x7f170c105b20 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f1708ff9640 1 -- 10.20.193.98:0/2571819213 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f16fc038a40 con 0x7f170c105b20 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f1708ff9640 1 -- 10.20.193.98:0/2571819213 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f16fc041930 con 0x7f170c105b20 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c1a1890 con 0x7f170c105b20 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c1a1e10 con 0x7f170c105b20 2026-02-20T02:25:58.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.718+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170c104d20 con 0x7f170c105b20 2026-02-20T02:25:58.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.719+0000 7f1708ff9640 1 -- 10.20.193.98:0/2571819213 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 18) ==== 100061+0+0 (secure 0 0 0) 0x7f16fc038bf0 con 0x7f170c105b20 2026-02-20T02:25:58.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.719+0000 7f1708ff9640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f16e0077510 0x7f16e00799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:25:58.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.719+0000 7f1708ff9640 1 -- 10.20.193.98:0/2571819213 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1485+0+0 (secure 0 0 0) 0x7f16fc03e070 con 0x7f170c105b20 2026-02-20T02:25:58.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.719+0000 7f170b7fe640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f16e0077510 0x7f16e00799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:25:58.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.720+0000 7f170b7fe640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f16e0077510 0x7f16e00799d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f170c105980 tx=0x7f16f8005eb0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:25:58.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.721+0000 7f1708ff9640 1 -- 10.20.193.98:0/2571819213 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f16fc050080 con 0x7f170c105b20 2026-02-20T02:25:58.810 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:25:58.809+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f170c0630c0 con 0x7f16e0077510 2026-02-20T02:25:58.965 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:58 trial098 ceph-mon[38923]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:25:58.965 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:58 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:58.966 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:58 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:58.966 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:58 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:58.966 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:58 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:58 trial106 ceph-mon[44052]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:25:59.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:58 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:58 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:58 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:58 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.957 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:25:59.958 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:25:59.958 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:25:59.958 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:59.958 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.958 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.958 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:25:59.958 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.958 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:25:59.959 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:25:59.959 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:25:59.959 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2378673919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4cad49e-fbde-4300-ba11-a955ab405675"}]: dispatch 2026-02-20T02:25:59.959 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2378673919' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4cad49e-fbde-4300-ba11-a955ab405675"}]': finished 2026-02-20T02:25:59.959 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: osdmap e7: 2 total, 0 up, 2 in 2026-02-20T02:25:59.959 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:25:59.959 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:25:59.959 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:25:59 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/491381113' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:00.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:00.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:00.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:00.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2378673919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4cad49e-fbde-4300-ba11-a955ab405675"}]: dispatch 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2378673919' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4cad49e-fbde-4300-ba11-a955ab405675"}]': finished 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: osdmap e7: 2 total, 0 up, 2 in 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:00.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:00.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:25:59 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/491381113' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:00 trial098 ceph-mon[38923]: Detected new or changed devices on trial098 2026-02-20T02:26:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:00 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial098 to 78799M 2026-02-20T02:26:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:00 trial098 ceph-mon[38923]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:26:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:00 trial106 ceph-mon[44052]: Detected new or changed devices on trial098 2026-02-20T02:26:01.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:00 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial098 to 78799M 2026-02-20T02:26:01.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:00 trial106 ceph-mon[44052]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:26:02.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:01 trial098 ceph-mon[38923]: from='osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-20T02:26:02.065 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:01 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0[57082]: 2026-02-20T02:26:01.741+0000 7f291a900740 -1 osd.0 0 log_to_monitors true 2026-02-20T02:26:02.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:01 trial106 ceph-mon[44052]: from='osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-20T02:26:02.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:02 trial098 ceph-mon[38923]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:26:02.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:02 trial098 ceph-mon[38923]: from='osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T02:26:02.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:02 trial098 ceph-mon[38923]: osdmap e8: 2 total, 0 up, 2 in 2026-02-20T02:26:02.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:02 trial098 ceph-mon[38923]: from='osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial098", "root=default"]}]: dispatch 2026-02-20T02:26:02.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:02 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:02.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:02 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:03.116 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:02 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0[57082]: 2026-02-20T02:26:02.961+0000 7f2916881640 -1 osd.0 0 waiting for initial osdmap 2026-02-20T02:26:03.116 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:02 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0[57082]: 2026-02-20T02:26:02.963+0000 7f290e6a3640 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T02:26:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:02 trial106 ceph-mon[44052]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:26:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:02 trial106 ceph-mon[44052]: from='osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T02:26:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:02 trial106 ceph-mon[44052]: osdmap e8: 2 total, 0 up, 2 in 2026-02-20T02:26:03.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:02 trial106 ceph-mon[44052]: from='osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial098", "root=default"]}]: dispatch 2026-02-20T02:26:03.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:02 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:03.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:02 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:03.943 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:03 trial098 ceph-mon[38923]: from='osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial098", "root=default"]}]': finished 2026-02-20T02:26:03.944 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:03 trial098 ceph-mon[38923]: osdmap e9: 2 total, 0 up, 2 in 2026-02-20T02:26:03.944 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:03.944 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:03.944 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:03.944 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-20T02:26:03.945 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:03.945 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:26:04.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:03 trial106 ceph-mon[44052]: from='osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial098", "root=default"]}]': finished 2026-02-20T02:26:04.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:03 trial106 ceph-mon[44052]: osdmap e9: 2 total, 0 up, 2 in 2026-02-20T02:26:04.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:04.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:04.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:04.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-20T02:26:04.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:04.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:26:04.977 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: purged_snaps scrub starts 2026-02-20T02:26:04.977 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: purged_snaps scrub ok 2026-02-20T02:26:04.977 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: OSD bench result of 91875.290441 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-20T02:26:04.977 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: Deploying daemon osd.1 on trial098 2026-02-20T02:26:04.977 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:26:04.977 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] boot 2026-02-20T02:26:04.977 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: osdmap e10: 2 total, 1 up, 2 in 2026-02-20T02:26:04.978 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:04.978 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:04 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:05.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: purged_snaps scrub starts 2026-02-20T02:26:05.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: purged_snaps scrub ok 2026-02-20T02:26:05.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: OSD bench result of 91875.290441 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-20T02:26:05.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: Deploying daemon osd.1 on trial098 2026-02-20T02:26:05.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T02:26:05.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: osd.0 [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] boot 2026-02-20T02:26:05.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: osdmap e10: 2 total, 1 up, 2 in 2026-02-20T02:26:05.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T02:26:05.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:04 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:05.940 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:05 trial098 ceph-mon[38923]: osdmap e11: 2 total, 1 up, 2 in 2026-02-20T02:26:05.940 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:05 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:05.940 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:05 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:05.940 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:05 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:05.940 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:05 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:05.940 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:05 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:05.940 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:05 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:06.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:05 trial106 ceph-mon[44052]: osdmap e11: 2 total, 1 up, 2 in 2026-02-20T02:26:06.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:05 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:06.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:05 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:06.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:05 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:06.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:05 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:06.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:05 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:06.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:05 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:06.228 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.226+0000 7f1708ff9640 1 -- 10.20.193.98:0/2571819213 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f170c0630c0 con 0x7f16e0077510 2026-02-20T02:26:06.228 INFO:teuthology.orchestra.run.trial098.stdout:Created osd(s) 1 on host 'trial098' 2026-02-20T02:26:06.230 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.228+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f16e0077510 msgr2=0x7f16e00799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:06.230 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.228+0000 7f1712046640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f16e0077510 0x7f16e00799d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f170c105980 tx=0x7f16f8005eb0 comp rx=0 tx=0).stop 2026-02-20T02:26:06.230 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.228+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 msgr2=0x7f170c19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:06.230 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.228+0000 7f1712046640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 0x7f170c19c890 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009ae0 tx=0x7f16fc004060 comp rx=0 tx=0).stop 2026-02-20T02:26:06.230 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.228+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 shutdown_connections 2026-02-20T02:26:06.231 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.228+0000 7f1712046640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f16e0077510 0x7f16e00799d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:06.231 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.228+0000 7f1712046640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f170c105b20 0x7f170c19c890 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:06.231 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.228+0000 7f1712046640 1 --2- 10.20.193.98:0/2571819213 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f170c104920 0x7f170c19c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:06.231 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.229+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 >> 10.20.193.98:0/2571819213 conn(0x7f170c1000b0 msgr2=0x7f170c109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:06.231 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.229+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 shutdown_connections 2026-02-20T02:26:06.231 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:06.229+0000 7f1712046640 1 -- 10.20.193.98:0/2571819213 wait complete. 2026-02-20T02:26:06.267 DEBUG:teuthology.orchestra.run.trial098:osd.1> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.1.service 2026-02-20T02:26:06.269 INFO:tasks.cephadm:Deploying osd.2 on trial098 with /dev/vg_nvme/lv_2... 2026-02-20T02:26:06.269 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-20T02:26:06.470 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:26:07.052 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T02:26:07.052 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.052 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.052 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:07.052 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:07.052 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.052 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:07.052 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.053 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.053 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:06 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1[63660]: 2026-02-20T02:26:06.838+0000 7f6d811a2740 -1 Falling back to public interface 2026-02-20T02:26:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T02:26:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:07.227 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:26:07.246 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch daemon add osd trial098:vg_nvme/lv_2 2026-02-20T02:26:07.421 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:26:07.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 -- 10.20.193.98:0/877322065 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44105b30 msgr2=0x7fac44105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:07.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 --2- 10.20.193.98:0/877322065 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44105b30 0x7fac44105fb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0099b0 tx=0x7fac2c02f220 comp rx=0 tx=0).stop 2026-02-20T02:26:07.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 -- 10.20.193.98:0/877322065 shutdown_connections 2026-02-20T02:26:07.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 --2- 10.20.193.98:0/877322065 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44105b30 0x7fac44105fb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:07.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 --2- 10.20.193.98:0/877322065 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fac44104930 0x7fac44104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:07.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 -- 10.20.193.98:0/877322065 >> 10.20.193.98:0/877322065 conn(0x7fac441000c0 msgr2=0x7fac44102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:07.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 -- 10.20.193.98:0/877322065 shutdown_connections 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 -- 10.20.193.98:0/877322065 wait complete. 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 Processor -- start 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 -- start start 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44104930 0x7fac4419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fac44105b30 0x7fac4419c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fac4410d560 con 0x7fac44104930 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac4971a640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fac4410d3e0 con 0x7fac44105b30 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac42ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44104930 0x7fac4419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac42ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44104930 0x7fac4419c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:34520/0 (socket says 10.20.193.98:34520) 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.537+0000 7fac42ffd640 1 -- 10.20.193.98:0/3946068981 learned_addr learned my addr 10.20.193.98:0/3946068981 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac42ffd640 1 -- 10.20.193.98:0/3946068981 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fac44105b30 msgr2=0x7fac4419c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:07.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac427fc640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fac44105b30 0x7fac4419c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac42ffd640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fac44105b30 0x7fac4419c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac42ffd640 1 -- 10.20.193.98:0/3946068981 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4419d060 con 0x7fac44104930 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac427fc640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fac44105b30 0x7fac4419c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac42ffd640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44104930 0x7fac4419c4a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac3800b4f0 tx=0x7fac3800b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac23fff640 1 -- 10.20.193.98:0/3946068981 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fac38004440 con 0x7fac44104930 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac441a1aa0 con 0x7fac44104930 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac23fff640 1 -- 10.20.193.98:0/3946068981 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fac38015070 con 0x7fac44104930 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac23fff640 1 -- 10.20.193.98:0/3946068981 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fac38010aa0 con 0x7fac44104930 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac441a2030 con 0x7fac44104930 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.538+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac44104db0 con 0x7fac44104930 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.539+0000 7fac23fff640 1 -- 10.20.193.98:0/3946068981 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 18) ==== 100061+0+0 (secure 0 0 0) 0x7fac38005ac0 con 0x7fac44104930 2026-02-20T02:26:07.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.539+0000 7fac23fff640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fac180774c0 0x7fac18079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:07.544 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.539+0000 7fac23fff640 1 -- 10.20.193.98:0/3946068981 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2095+0+0 (secure 0 0 0) 0x7fac38098ac0 con 0x7fac44104930 2026-02-20T02:26:07.544 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.539+0000 7fac427fc640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fac180774c0 0x7fac18079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:07.544 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.540+0000 7fac427fc640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fac180774c0 0x7fac18079980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0097c0 tx=0x7fac2c0023d0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:07.544 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.542+0000 7fac23fff640 1 -- 10.20.193.98:0/3946068981 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fac38066a20 con 0x7fac44104930 2026-02-20T02:26:07.632 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:07.631+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fac441a23b0 con 0x7fac180774c0 2026-02-20T02:26:08.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T02:26:08.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:08.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:08.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:08.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:08.222 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:08.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:08.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:08.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:08.223 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:08 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:08.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:08 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:09.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:09 trial098 ceph-mon[38923]: Detected new or changed devices on trial098 2026-02-20T02:26:09.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:09 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial098 to 39399M 2026-02-20T02:26:09.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:09 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2149628255' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ec05305-8212-4015-b82a-66a1c330bff3"}]: dispatch 2026-02-20T02:26:09.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:09 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2149628255' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ec05305-8212-4015-b82a-66a1c330bff3"}]': finished 2026-02-20T02:26:09.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:09 trial098 ceph-mon[38923]: osdmap e12: 3 total, 1 up, 3 in 2026-02-20T02:26:09.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:09 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:09.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:09 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:09.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:09 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2203215238' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:09.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:09 trial106 ceph-mon[44052]: Detected new or changed devices on trial098 2026-02-20T02:26:09.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:09 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial098 to 39399M 2026-02-20T02:26:09.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:09 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2149628255' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ec05305-8212-4015-b82a-66a1c330bff3"}]: dispatch 2026-02-20T02:26:09.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:09 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2149628255' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ec05305-8212-4015-b82a-66a1c330bff3"}]': finished 2026-02-20T02:26:09.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:09 trial106 ceph-mon[44052]: osdmap e12: 3 total, 1 up, 3 in 2026-02-20T02:26:09.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:09 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:09.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:09 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:09.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:09 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2203215238' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:09.992 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:09 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1[63660]: 2026-02-20T02:26:09.706+0000 7f6d811a2740 -1 osd.1 0 log_to_monitors true 2026-02-20T02:26:10.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:10 trial098 ceph-mon[38923]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T02:26:10.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:10 trial098 ceph-mon[38923]: from='osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-20T02:26:10.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:10 trial106 ceph-mon[44052]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T02:26:10.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:10 trial106 ceph-mon[44052]: from='osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-20T02:26:11.484 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:11 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1[63660]: 2026-02-20T02:26:11.328+0000 7f6d7d123640 -1 osd.1 0 waiting for initial osdmap 2026-02-20T02:26:11.484 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:11 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1[63660]: 2026-02-20T02:26:11.329+0000 7f6d74f45640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T02:26:11.485 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:11 trial098 ceph-mon[38923]: from='osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-20T02:26:11.485 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:11 trial098 ceph-mon[38923]: osdmap e13: 3 total, 1 up, 3 in 2026-02-20T02:26:11.485 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:11 trial098 ceph-mon[38923]: from='osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial098", "root=default"]}]: dispatch 2026-02-20T02:26:11.485 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:11 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:11.485 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:11 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:11.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:11 trial106 ceph-mon[44052]: from='osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-20T02:26:11.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:11 trial106 ceph-mon[44052]: osdmap e13: 3 total, 1 up, 3 in 2026-02-20T02:26:11.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:11 trial106 ceph-mon[44052]: from='osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial098", "root=default"]}]: dispatch 2026-02-20T02:26:11.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:11 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:11.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:11 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:12.284 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:12 trial098 ceph-mon[38923]: from='osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial098", "root=default"]}]': finished 2026-02-20T02:26:12.284 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:12 trial098 ceph-mon[38923]: osdmap e14: 3 total, 1 up, 3 in 2026-02-20T02:26:12.285 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:12 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:12.285 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:12 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:12.285 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:12 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:12.285 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:12 trial098 ceph-mon[38923]: pgmap v21: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T02:26:12.285 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:12 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-20T02:26:12.285 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:12 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:12.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:12 trial106 ceph-mon[44052]: from='osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial098", "root=default"]}]': finished 2026-02-20T02:26:12.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:12 trial106 ceph-mon[44052]: osdmap e14: 3 total, 1 up, 3 in 2026-02-20T02:26:12.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:12 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:12.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:12 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:12.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:12 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:12.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:12 trial106 ceph-mon[44052]: pgmap v21: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T02:26:12.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:12 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-20T02:26:12.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:12 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:13.547 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: purged_snaps scrub starts 2026-02-20T02:26:13.548 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: purged_snaps scrub ok 2026-02-20T02:26:13.548 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: OSD bench result of 103487.958141 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-20T02:26:13.548 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: Deploying daemon osd.2 on trial098 2026-02-20T02:26:13.548 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:13.548 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] boot 2026-02-20T02:26:13.548 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: osdmap e15: 3 total, 2 up, 3 in 2026-02-20T02:26:13.548 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:13.548 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:13 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:13.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: purged_snaps scrub starts 2026-02-20T02:26:13.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: purged_snaps scrub ok 2026-02-20T02:26:13.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: OSD bench result of 103487.958141 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-20T02:26:13.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: Deploying daemon osd.2 on trial098 2026-02-20T02:26:13.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:13.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: osd.1 [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] boot 2026-02-20T02:26:13.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: osdmap e15: 3 total, 2 up, 3 in 2026-02-20T02:26:13.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T02:26:13.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:13 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:14.442 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:14 trial098 ceph-mon[38923]: osdmap e16: 3 total, 2 up, 3 in 2026-02-20T02:26:14.442 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:14 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:14.442 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:14 trial098 ceph-mon[38923]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:14.443 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:14 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:14.443 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:14 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:14.443 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:14 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:14.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:14 trial106 ceph-mon[44052]: osdmap e16: 3 total, 2 up, 3 in 2026-02-20T02:26:14.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:14 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:14.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:14 trial106 ceph-mon[44052]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:14.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:14 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:14.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:14 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:14.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:14 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:15.056 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.054+0000 7fac23fff640 1 -- 10.20.193.98:0/3946068981 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fac441a23b0 con 0x7fac180774c0 2026-02-20T02:26:15.057 INFO:teuthology.orchestra.run.trial098.stdout:Created osd(s) 2 on host 'trial098' 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fac180774c0 msgr2=0x7fac18079980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fac180774c0 0x7fac18079980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0097c0 tx=0x7fac2c0023d0 comp rx=0 tx=0).stop 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44104930 msgr2=0x7fac4419c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44104930 0x7fac4419c4a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac3800b4f0 tx=0x7fac3800b9c0 comp rx=0 tx=0).stop 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 shutdown_connections 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fac180774c0 0x7fac18079980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fac44105b30 0x7fac4419c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 --2- 10.20.193.98:0/3946068981 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fac44104930 0x7fac4419c4a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 >> 10.20.193.98:0/3946068981 conn(0x7fac441000c0 msgr2=0x7fac44108d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 shutdown_connections 2026-02-20T02:26:15.059 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:15.056+0000 7fac4971a640 1 -- 10.20.193.98:0/3946068981 wait complete. 2026-02-20T02:26:15.095 DEBUG:teuthology.orchestra.run.trial098:osd.2> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.2.service 2026-02-20T02:26:15.097 INFO:tasks.cephadm:Deploying osd.3 on trial098 with /dev/vg_nvme/lv_1... 2026-02-20T02:26:15.097 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-20T02:26:15.312 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:26:16.052 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:16 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2[70226]: 2026-02-20T02:26:16.028+0000 7f5e2d19d740 -1 Falling back to public interface 2026-02-20T02:26:16.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:16.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: Detected new or changed devices on trial098 2026-02-20T02:26:16.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial098 to 26266M 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:16.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:16.317 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: Detected new or changed devices on trial098 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial098 to 26266M 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:16.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:16.535 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:26:16.551 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch daemon add osd trial098:vg_nvme/lv_1 2026-02-20T02:26:16.709 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 -- 10.20.193.98:0/2522024534 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481038b0 msgr2=0x7f6d48103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 --2- 10.20.193.98:0/2522024534 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481038b0 0x7f6d48103d30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0099b0 tx=0x7f6d3c02f220 comp rx=0 tx=0).stop 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 -- 10.20.193.98:0/2522024534 shutdown_connections 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 --2- 10.20.193.98:0/2522024534 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481038b0 0x7f6d48103d30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 --2- 10.20.193.98:0/2522024534 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6d481026b0 0x7f6d48102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 -- 10.20.193.98:0/2522024534 >> 10.20.193.98:0/2522024534 conn(0x7f6d480fde40 msgr2=0x7f6d48100280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 -- 10.20.193.98:0/2522024534 shutdown_connections 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 -- 10.20.193.98:0/2522024534 wait complete. 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 Processor -- start 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 -- start start 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481026b0 0x7f6d48076da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6d481038b0 0x7f6d48075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4810b260 con 0x7f6d481026b0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4f423640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4810b0e0 con 0x7f6d481038b0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4d198640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481026b0 0x7f6d48076da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4d198640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481026b0 0x7f6d48076da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:57258/0 (socket says 10.20.193.98:57258) 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4d198640 1 -- 10.20.193.98:0/1750418341 learned_addr learned my addr 10.20.193.98:0/1750418341 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4d198640 1 -- 10.20.193.98:0/1750418341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6d481038b0 msgr2=0x7f6d48075460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4c997640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6d481038b0 0x7f6d48075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4d198640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6d481038b0 0x7f6d48075460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4d198640 1 -- 10.20.193.98:0/1750418341 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480759a0 con 0x7f6d481026b0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.815+0000 7f6d4c997640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6d481038b0 0x7f6d48075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.816+0000 7f6d4d198640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481026b0 0x7f6d48076da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800d900 tx=0x7f6d3800ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.816+0000 7f6d367fc640 1 -- 10.20.193.98:0/1750418341 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6d38014070 con 0x7f6d481026b0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.816+0000 7f6d367fc640 1 -- 10.20.193.98:0/1750418341 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6d380044a0 con 0x7f6d481026b0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.816+0000 7f6d367fc640 1 -- 10.20.193.98:0/1750418341 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6d38002c30 con 0x7f6d481026b0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.816+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d48075c90 con 0x7f6d481026b0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.816+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d480762a0 con 0x7f6d481026b0 2026-02-20T02:26:16.819 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.816+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d48102ab0 con 0x7f6d481026b0 2026-02-20T02:26:16.820 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.817+0000 7f6d367fc640 1 -- 10.20.193.98:0/1750418341 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 18) ==== 100061+0+0 (secure 0 0 0) 0x7f6d3800b840 con 0x7f6d481026b0 2026-02-20T02:26:16.820 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.817+0000 7f6d367fc640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6d24077510 0x7f6d240799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:16.820 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.817+0000 7f6d367fc640 1 -- 10.20.193.98:0/1750418341 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2527+0+0 (secure 0 0 0) 0x7f6d38098dc0 con 0x7f6d481026b0 2026-02-20T02:26:16.820 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.817+0000 7f6d4c997640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6d24077510 0x7f6d240799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:16.820 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.817+0000 7f6d4c997640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6d24077510 0x7f6d240799d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0097c0 tx=0x7f6d3c005c70 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:16.820 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.819+0000 7f6d367fc640 1 -- 10.20.193.98:0/1750418341 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6d38066b50 con 0x7f6d481026b0 2026-02-20T02:26:16.908 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:16.907+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6d480630c0 con 0x7f6d24077510 2026-02-20T02:26:17.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:17 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:17.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:17 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:17.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:17 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:17.435 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:17 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:17.436 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:17 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:17.436 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:17 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:18.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:18 trial106 ceph-mon[44052]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:18 trial106 ceph-mon[44052]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:18 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1537677943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62e618a0-0ca1-40e0-8beb-24b9d89ecfc4"}]: dispatch 2026-02-20T02:26:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:18 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1537677943' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62e618a0-0ca1-40e0-8beb-24b9d89ecfc4"}]': finished 2026-02-20T02:26:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:18 trial106 ceph-mon[44052]: osdmap e17: 4 total, 2 up, 4 in 2026-02-20T02:26:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:18 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/3964495120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:18.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:18 trial098 ceph-mon[38923]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:18.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:18 trial098 ceph-mon[38923]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:18.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:18 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1537677943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62e618a0-0ca1-40e0-8beb-24b9d89ecfc4"}]: dispatch 2026-02-20T02:26:18.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:18 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1537677943' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62e618a0-0ca1-40e0-8beb-24b9d89ecfc4"}]': finished 2026-02-20T02:26:18.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:18 trial098 ceph-mon[38923]: osdmap e17: 4 total, 2 up, 4 in 2026-02-20T02:26:18.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:18.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:18.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:18 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3964495120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:26:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:19 trial098 ceph-mon[38923]: from='osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-20T02:26:19.194 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:18 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2[70226]: 2026-02-20T02:26:18.846+0000 7f5e2d19d740 -1 osd.2 0 log_to_monitors true 2026-02-20T02:26:19.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:26:19.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:19 trial106 ceph-mon[44052]: from='osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-20T02:26:20.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:20 trial098 ceph-mon[38923]: from='osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-20T02:26:20.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:20 trial098 ceph-mon[38923]: osdmap e18: 4 total, 2 up, 4 in 2026-02-20T02:26:20.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:20 trial098 ceph-mon[38923]: from='osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial098", "root=default"]}]: dispatch 2026-02-20T02:26:20.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:20.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:20.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:20 trial098 ceph-mon[38923]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:20.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:20 trial098 ceph-mon[38923]: from='osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial098", "root=default"]}]': finished 2026-02-20T02:26:20.316 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:20 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2[70226]: 2026-02-20T02:26:20.094+0000 7f5e2911e640 -1 osd.2 0 waiting for initial osdmap 2026-02-20T02:26:20.316 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:20 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2[70226]: 2026-02-20T02:26:20.096+0000 7f5e24f48640 -1 osd.2 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T02:26:20.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:20 trial106 ceph-mon[44052]: from='osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-20T02:26:20.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:20 trial106 ceph-mon[44052]: osdmap e18: 4 total, 2 up, 4 in 2026-02-20T02:26:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:20 trial106 ceph-mon[44052]: from='osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial098", "root=default"]}]: dispatch 2026-02-20T02:26:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:20 trial106 ceph-mon[44052]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:20 trial106 ceph-mon[44052]: from='osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial098", "root=default"]}]': finished 2026-02-20T02:26:21.199 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:21 trial098 ceph-mon[38923]: osdmap e19: 4 total, 2 up, 4 in 2026-02-20T02:26:21.199 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:21.199 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:21.199 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:21 trial106 ceph-mon[44052]: osdmap e19: 4 total, 2 up, 4 in 2026-02-20T02:26:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:22.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: purged_snaps scrub starts 2026-02-20T02:26:22.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: purged_snaps scrub ok 2026-02-20T02:26:22.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:22.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] boot 2026-02-20T02:26:22.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: osdmap e20: 4 total, 3 up, 4 in 2026-02-20T02:26:22.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:22.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:22.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-20T02:26:22.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:22.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: Deploying daemon osd.3 on trial098 2026-02-20T02:26:22.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:22.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: purged_snaps scrub starts 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: purged_snaps scrub ok 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: osd.2 [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] boot 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: osdmap e20: 4 total, 3 up, 4 in 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-20T02:26:22.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:22.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: Deploying daemon osd.3 on trial098 2026-02-20T02:26:22.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T02:26:22.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-20T02:26:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-20T02:26:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 ceph-mon[38923]: osdmap e21: 4 total, 3 up, 4 in 2026-02-20T02:26:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T02:26:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-20T02:26:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 ceph-mon[44052]: osdmap e21: 4 total, 3 up, 4 in 2026-02-20T02:26:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T02:26:23.737 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76549]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-20T02:26:23.737 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76549]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:23.737 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:23.738 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76549]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:23.738 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76576]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-20T02:26:23.738 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76576]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:23.738 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:23.738 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76576]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:23.738 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76469]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-20T02:26:23.738 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76469]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:23.739 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:23.739 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76469]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:23.739 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76496]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-20T02:26:23.739 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76496]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:23.739 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:23.739 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76496]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:23.739 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76414]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-20T02:26:23.739 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76414]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76414]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76438]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76438]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76438]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76504]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76504]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:23.740 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:23.741 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76504]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:23.741 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76529]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-20T02:26:23.741 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76529]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:23.741 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:23.741 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:26:23 trial098 sudo[76529]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:24.094 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.092+0000 7f6d367fc640 1 -- 10.20.193.98:0/1750418341 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f6d480630c0 con 0x7f6d24077510 2026-02-20T02:26:24.094 INFO:teuthology.orchestra.run.trial098.stdout:Created osd(s) 3 on host 'trial098' 2026-02-20T02:26:24.096 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6d24077510 msgr2=0x7f6d240799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:24.096 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6d24077510 0x7f6d240799d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0097c0 tx=0x7f6d3c005c70 comp rx=0 tx=0).stop 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481026b0 msgr2=0x7f6d48076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481026b0 0x7f6d48076da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800d900 tx=0x7f6d3800ddd0 comp rx=0 tx=0).stop 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 shutdown_connections 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6d24077510 0x7f6d240799d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6d481038b0 0x7f6d48075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 --2- 10.20.193.98:0/1750418341 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6d481026b0 0x7f6d48076da0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 >> 10.20.193.98:0/1750418341 conn(0x7f6d480fde40 msgr2=0x7f6d48106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 shutdown_connections 2026-02-20T02:26:24.097 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:26:24.095+0000 7f6d4f423640 1 -- 10.20.193.98:0/1750418341 wait complete. 2026-02-20T02:26:24.106 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 sudo[47256]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-20T02:26:24.106 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 sudo[47256]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:24.106 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 sudo[47256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:24.106 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 sudo[47256]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:24.106 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 sudo[47260]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-20T02:26:24.106 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 sudo[47260]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T02:26:24.106 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 sudo[47260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T02:26:24.106 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:23 trial106 sudo[47260]: pam_unix(sudo:session): session closed for user root 2026-02-20T02:26:24.152 DEBUG:teuthology.orchestra.run.trial098:osd.3> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.3.service 2026-02-20T02:26:24.155 INFO:tasks.cephadm:Deploying osd.4 on trial106 with /dev/vg_nvme/lv_4... 2026-02-20T02:26:24.156 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-20T02:26:24.312 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:26:24.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-20T02:26:24.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: osdmap e22: 4 total, 3 up, 4 in 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: pgmap v35: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:26:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T02:26:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:26:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:26:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T02:26:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.358 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-20T02:26:24.358 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: osdmap e22: 4 total, 3 up, 4 in 2026-02-20T02:26:24.358 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:24.358 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: pgmap v35: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial098"}]: dispatch 2026-02-20T02:26:24.359 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mon metadata", "id": "trial106"}]: dispatch 2026-02-20T02:26:24.360 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T02:26:24.360 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.360 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:24.360 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.065 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:26:25.081 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch daemon add osd trial106:vg_nvme/lv_4 2026-02-20T02:26:25.234 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:26:25.239 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:26:24 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3[76054]: 2026-02-20T02:26:24.878+0000 7fc50c0d4740 -1 Falling back to public interface 2026-02-20T02:26:25.257 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: mgrmap e19: trial098.hiicxh(active, since 50s), standbys: trial106.gehstk 2026-02-20T02:26:25.257 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: osdmap e23: 4 total, 3 up, 4 in 2026-02-20T02:26:25.257 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:25.257 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.258 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:25.259 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:25.259 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:25.259 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 -- 10.20.193.106:0/1009712849 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 msgr2=0x7f0e40077ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:25.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 --2- 10.20.193.106:0/1009712849 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 0x7f0e40077ea0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0e300099b0 tx=0x7f0e3002f220 comp rx=0 tx=0).stop 2026-02-20T02:26:25.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 -- 10.20.193.106:0/1009712849 shutdown_connections 2026-02-20T02:26:25.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 --2- 10.20.193.106:0/1009712849 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0e40078cf0 0x7f0e40079150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:25.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 --2- 10.20.193.106:0/1009712849 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 0x7f0e40077ea0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:25.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 -- 10.20.193.106:0/1009712849 >> 10.20.193.106:0/1009712849 conn(0x7f0e401000b0 msgr2=0x7f0e401024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:25.338 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 -- 10.20.193.106:0/1009712849 shutdown_connections 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 -- 10.20.193.106:0/1009712849 wait complete. 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 Processor -- start 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 -- start start 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 0x7f0e401a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0e40078cf0 0x7f0e401a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e401119c0 con 0x7f0e40078cf0 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e47418640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0e40111840 con 0x7f0e40077aa0 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e4518d640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 0x7f0e401a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e4518d640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 0x7f0e401a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.106:3300/0 says I am v2:10.20.193.106:47844/0 (socket says 10.20.193.106:47844) 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.334+0000 7f0e4518d640 1 -- 10.20.193.106:0/175877394 learned_addr learned my addr 10.20.193.106:0/175877394 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:26:25.339 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e4498c640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0e40078cf0 0x7f0e401a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e4518d640 1 -- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0e40078cf0 msgr2=0x7f0e401a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e4518d640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0e40078cf0 0x7f0e401a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e4518d640 1 -- 10.20.193.106:0/175877394 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e401a13f0 con 0x7f0e40077aa0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e4518d640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 0x7f0e401a0830 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0e30002410 tx=0x7f0e3002fe10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e2e7fc640 1 -- 10.20.193.106:0/175877394 <== mon.1 v2:10.20.193.106:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0e30004420 con 0x7f0e40077aa0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e2e7fc640 1 -- 10.20.193.106:0/175877394 <== mon.1 v2:10.20.193.106:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f0e30038a40 con 0x7f0e40077aa0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e401a5dd0 con 0x7f0e40077aa0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e2e7fc640 1 -- 10.20.193.106:0/175877394 <== mon.1 v2:10.20.193.106:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0e300418e0 con 0x7f0e40077aa0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e401a6300 con 0x7f0e40077aa0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.335+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e40077ea0 con 0x7f0e40077aa0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.336+0000 7f0e2e7fc640 1 -- 10.20.193.106:0/175877394 <== mon.1 v2:10.20.193.106:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f0e30038bf0 con 0x7f0e40077aa0 2026-02-20T02:26:25.340 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.336+0000 7f0e2e7fc640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f0e1c0775a0 0x7f0e1c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:25.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.336+0000 7f0e2e7fc640 1 -- 10.20.193.106:0/175877394 <== mon.1 v2:10.20.193.106:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3345+0+0 (secure 0 0 0) 0x7f0e3003e070 con 0x7f0e40077aa0 2026-02-20T02:26:25.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.337+0000 7f0e4498c640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f0e1c0775a0 0x7f0e1c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:25.341 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.337+0000 7f0e4498c640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f0e1c0775a0 0x7f0e1c079a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0e34005fd0 tx=0x7f0e34005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:25.342 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.339+0000 7f0e2e7fc640 1 -- 10.20.193.106:0/175877394 <== mon.1 v2:10.20.193.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0e3008b820 con 0x7f0e40077aa0 2026-02-20T02:26:25.427 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:25.426+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0e400630c0 con 0x7f0e1c0775a0 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: mgrmap e19: trial098.hiicxh(active, since 50s), standbys: trial106.gehstk 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: osdmap e23: 4 total, 3 up, 4 in 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:25.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:25.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:25.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:25.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:25.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:25.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:25.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:25.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:26.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: Detected new or changed devices on trial098 2026-02-20T02:26:26.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial098 to 19699M 2026-02-20T02:26:26.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: pgmap v37: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/2175453549' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35dfa3a0-e20f-407f-a124-753ef1241351"}]: dispatch 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35dfa3a0-e20f-407f-a124-753ef1241351"}]: dispatch 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35dfa3a0-e20f-407f-a124-753ef1241351"}]': finished 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: osdmap e24: 5 total, 3 up, 5 in 2026-02-20T02:26:26.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:26.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:26.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: Detected new or changed devices on trial098 2026-02-20T02:26:26.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial098 to 19699M 2026-02-20T02:26:26.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:26.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: pgmap v37: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/2175453549' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35dfa3a0-e20f-407f-a124-753ef1241351"}]: dispatch 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35dfa3a0-e20f-407f-a124-753ef1241351"}]: dispatch 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35dfa3a0-e20f-407f-a124-753ef1241351"}]': finished 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: osdmap e24: 5 total, 3 up, 5 in 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:26.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:27.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:27 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/3985869342' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:27.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:27 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/3985869342' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:28.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:28 trial098 ceph-mon[38923]: pgmap v39: 1 pgs: 1 creating+activating; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T02:26:28.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:28 trial098 ceph-mon[38923]: from='osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-20T02:26:28.565 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:26:28 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3[76054]: 2026-02-20T02:26:28.098+0000 7fc50c0d4740 -1 osd.3 0 log_to_monitors true 2026-02-20T02:26:28.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:28 trial106 ceph-mon[44052]: pgmap v39: 1 pgs: 1 creating+activating; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T02:26:28.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:28 trial106 ceph-mon[44052]: from='osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-20T02:26:29.403 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:29 trial106 ceph-mon[44052]: from='osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T02:26:29.403 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:29 trial106 ceph-mon[44052]: osdmap e25: 5 total, 3 up, 5 in 2026-02-20T02:26:29.403 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:29 trial106 ceph-mon[44052]: from='osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial098", "root=default"]}]: dispatch 2026-02-20T02:26:29.403 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:29.403 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:29.465 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:29 trial098 ceph-mon[38923]: from='osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T02:26:29.465 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:29 trial098 ceph-mon[38923]: osdmap e25: 5 total, 3 up, 5 in 2026-02-20T02:26:29.465 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:29 trial098 ceph-mon[38923]: from='osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial098", "root=default"]}]: dispatch 2026-02-20T02:26:29.466 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:29.466 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:29.466 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:26:29 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3[76054]: 2026-02-20T02:26:29.249+0000 7fc508055640 -1 osd.3 0 waiting for initial osdmap 2026-02-20T02:26:29.466 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:26:29 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3[76054]: 2026-02-20T02:26:29.252+0000 7fc503e7f640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T02:26:30.495 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: from='osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial098", "root=default"]}]': finished 2026-02-20T02:26:30.496 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: osdmap e26: 5 total, 3 up, 5 in 2026-02-20T02:26:30.496 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:30.496 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:30.496 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:30.496 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T02:26:30.496 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-20T02:26:30.496 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:30.496 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:30 trial106 ceph-mon[44052]: Deploying daemon osd.4 on trial106 2026-02-20T02:26:30.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: from='osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial098", "root=default"]}]': finished 2026-02-20T02:26:30.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: osdmap e26: 5 total, 3 up, 5 in 2026-02-20T02:26:30.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:30.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:30.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:30.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T02:26:30.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-20T02:26:30.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:30.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:30 trial098 ceph-mon[38923]: Deploying daemon osd.4 on trial106 2026-02-20T02:26:31.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:31 trial098 ceph-mon[38923]: purged_snaps scrub starts 2026-02-20T02:26:31.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:31 trial098 ceph-mon[38923]: purged_snaps scrub ok 2026-02-20T02:26:31.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:31.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:31 trial098 ceph-mon[38923]: osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] boot 2026-02-20T02:26:31.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:31 trial098 ceph-mon[38923]: osdmap e27: 5 total, 4 up, 5 in 2026-02-20T02:26:31.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:31.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:31.566 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:31 trial106 ceph-mon[44052]: purged_snaps scrub starts 2026-02-20T02:26:31.566 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:31 trial106 ceph-mon[44052]: purged_snaps scrub ok 2026-02-20T02:26:31.566 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:31.566 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:31 trial106 ceph-mon[44052]: osd.3 [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] boot 2026-02-20T02:26:31.566 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:31 trial106 ceph-mon[44052]: osdmap e27: 5 total, 4 up, 5 in 2026-02-20T02:26:31.566 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T02:26:31.566 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:32.518 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:32 trial106 ceph-mon[44052]: osdmap e28: 5 total, 4 up, 5 in 2026-02-20T02:26:32.518 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:32.518 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:32 trial106 ceph-mon[44052]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T02:26:32.518 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:32.518 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:32.518 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:32.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:32 trial098 ceph-mon[38923]: osdmap e28: 5 total, 4 up, 5 in 2026-02-20T02:26:32.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:32.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:32 trial098 ceph-mon[38923]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T02:26:32.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:32.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:32.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:33.093 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.091+0000 7f0e2e7fc640 1 -- 10.20.193.106:0/175877394 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f0e400630c0 con 0x7f0e1c0775a0 2026-02-20T02:26:33.093 INFO:teuthology.orchestra.run.trial106.stdout:Created osd(s) 4 on host 'trial106' 2026-02-20T02:26:33.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f0e1c0775a0 msgr2=0x7f0e1c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:33.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f0e1c0775a0 0x7f0e1c079a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0e34005fd0 tx=0x7f0e34005950 comp rx=0 tx=0).stop 2026-02-20T02:26:33.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 msgr2=0x7f0e401a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:33.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 0x7f0e401a0830 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0e30002410 tx=0x7f0e3002fe10 comp rx=0 tx=0).stop 2026-02-20T02:26:33.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 shutdown_connections 2026-02-20T02:26:33.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f0e1c0775a0 0x7f0e1c079a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:33.095 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f0e40078cf0 0x7f0e401a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:33.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 --2- 10.20.193.106:0/175877394 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f0e40077aa0 0x7f0e401a0830 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:33.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 >> 10.20.193.106:0/175877394 conn(0x7f0e401000b0 msgr2=0x7f0e4010f200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:33.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 shutdown_connections 2026-02-20T02:26:33.096 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:33.093+0000 7f0e47418640 1 -- 10.20.193.106:0/175877394 wait complete. 2026-02-20T02:26:33.131 DEBUG:teuthology.orchestra.run.trial106:osd.4> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.4.service 2026-02-20T02:26:33.133 INFO:tasks.cephadm:Deploying osd.5 on trial106 with /dev/vg_nvme/lv_3... 2026-02-20T02:26:33.134 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-20T02:26:33.329 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:26:33.618 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:26:33 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:26:33.516+0000 7fd29e7e4740 -1 Falling back to public interface 2026-02-20T02:26:33.967 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:33.968 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:33.968 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:33.968 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:33.968 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:33.968 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:33.968 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:33.968 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:33.968 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:26:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:26:34.481 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:26:34.501 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch daemon add osd trial106:vg_nvme/lv_3 2026-02-20T02:26:34.655 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:26:34.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.766+0000 7f164dcbf640 1 -- 10.20.193.106:0/3255732805 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 msgr2=0x7f1648079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:34.770 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.766+0000 7f164dcbf640 1 --2- 10.20.193.106:0/3255732805 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 0x7f1648079150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f16380099b0 tx=0x7f163802f220 comp rx=0 tx=0).stop 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.766+0000 7f164dcbf640 1 -- 10.20.193.106:0/3255732805 shutdown_connections 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.766+0000 7f164dcbf640 1 --2- 10.20.193.106:0/3255732805 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 0x7f1648079150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.766+0000 7f164dcbf640 1 --2- 10.20.193.106:0/3255732805 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1648077aa0 0x7f1648077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.766+0000 7f164dcbf640 1 -- 10.20.193.106:0/3255732805 >> 10.20.193.106:0/3255732805 conn(0x7f16481000b0 msgr2=0x7f16481024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.766+0000 7f164dcbf640 1 -- 10.20.193.106:0/3255732805 shutdown_connections 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.766+0000 7f164dcbf640 1 -- 10.20.193.106:0/3255732805 wait complete. 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f164dcbf640 1 Processor -- start 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f164dcbf640 1 -- start start 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f164dcbf640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1648077aa0 0x7f16481a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f164dcbf640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 0x7f16481a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:34.771 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f164dcbf640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16481119c0 con 0x7f1648077aa0 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f164dcbf640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1648111840 con 0x7f1648078cf0 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f1646ffd640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 0x7f16481a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f1646ffd640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 0x7f16481a0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.106:3300/0 says I am v2:10.20.193.106:50482/0 (socket says 10.20.193.106:50482) 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f1646ffd640 1 -- 10.20.193.106:0/1747465498 learned_addr learned my addr 10.20.193.106:0/1747465498 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f16477fe640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1648077aa0 0x7f16481a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f1646ffd640 1 -- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1648077aa0 msgr2=0x7f16481a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f1646ffd640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1648077aa0 0x7f16481a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f1646ffd640 1 -- 10.20.193.106:0/1747465498 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16481a1460 con 0x7f1648078cf0 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.767+0000 7f1646ffd640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 0x7f16481a0de0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1638009ae0 tx=0x7f1638002820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.768+0000 7f1644ff9640 1 -- 10.20.193.106:0/1747465498 <== mon.1 v2:10.20.193.106:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f16380044e0 con 0x7f1648078cf0 2026-02-20T02:26:34.772 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.768+0000 7f1644ff9640 1 -- 10.20.193.106:0/1747465498 <== mon.1 v2:10.20.193.106:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1638038a40 con 0x7f1648078cf0 2026-02-20T02:26:34.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.768+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16481a5e40 con 0x7f1648078cf0 2026-02-20T02:26:34.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.768+0000 7f1644ff9640 1 -- 10.20.193.106:0/1747465498 <== mon.1 v2:10.20.193.106:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1638041980 con 0x7f1648078cf0 2026-02-20T02:26:34.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.768+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16481a63c0 con 0x7f1648078cf0 2026-02-20T02:26:34.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.768+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1648077ea0 con 0x7f1648078cf0 2026-02-20T02:26:34.773 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.769+0000 7f1644ff9640 1 -- 10.20.193.106:0/1747465498 <== mon.1 v2:10.20.193.106:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f16380385d0 con 0x7f1648078cf0 2026-02-20T02:26:34.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.769+0000 7f1644ff9640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f161c0775a0 0x7f161c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:34.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.769+0000 7f1644ff9640 1 -- 10.20.193.106:0/1747465498 <== mon.1 v2:10.20.193.106:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3777+0+0 (secure 0 0 0) 0x7f163803e070 con 0x7f1648078cf0 2026-02-20T02:26:34.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.769+0000 7f16477fe640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f161c0775a0 0x7f161c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:34.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.770+0000 7f16477fe640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f161c0775a0 0x7f161c079a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1634003920 tx=0x7f1634005f50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:34.774 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.771+0000 7f1644ff9640 1 -- 10.20.193.106:0/1747465498 <== mon.1 v2:10.20.193.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f163808b800 con 0x7f1648078cf0 2026-02-20T02:26:34.860 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:34.859+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f16481104a0 con 0x7f161c0775a0 2026-02-20T02:26:35.046 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T02:26:35.047 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: Detected new or changed devices on trial106 2026-02-20T02:26:35.047 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:35.047 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:35.047 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:35.047 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial106 to 81871M 2026-02-20T02:26:35.047 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:35.047 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:35.047 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:35.048 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:35.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T02:26:35.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: Detected new or changed devices on trial106 2026-02-20T02:26:35.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:35.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:35.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:35.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial106 to 81871M 2026-02-20T02:26:35.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:35.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:35.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:35.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:36.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:36.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:36.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:36.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:36.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/4093367738' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646d457d-9777-4425-a4c6-edb74643b7e1"}]: dispatch 2026-02-20T02:26:36.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646d457d-9777-4425-a4c6-edb74643b7e1"}]: dispatch 2026-02-20T02:26:36.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "646d457d-9777-4425-a4c6-edb74643b7e1"}]': finished 2026-02-20T02:26:36.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: osdmap e29: 6 total, 4 up, 6 in 2026-02-20T02:26:36.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:36.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:35 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:36.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/4093367738' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646d457d-9777-4425-a4c6-edb74643b7e1"}]: dispatch 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646d457d-9777-4425-a4c6-edb74643b7e1"}]: dispatch 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "646d457d-9777-4425-a4c6-edb74643b7e1"}]': finished 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: osdmap e29: 6 total, 4 up, 6 in 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:36.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:35 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:36.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:36 trial106 ceph-mon[44052]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T02:26:36.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:36 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/1570575035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:36.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:36 trial106 ceph-mon[44052]: from='osd.4 [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T02:26:36.869 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:36 trial106 ceph-mon[44052]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T02:26:36.869 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:26:36 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:26:36.582+0000 7fd29e7e4740 -1 osd.4 0 log_to_monitors true 2026-02-20T02:26:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:36 trial098 ceph-mon[38923]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T02:26:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:36 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/1570575035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:36 trial098 ceph-mon[38923]: from='osd.4 [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T02:26:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:36 trial098 ceph-mon[38923]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T02:26:38.118 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:26:37 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:26:37.980+0000 7fd29a765640 -1 osd.4 0 waiting for initial osdmap 2026-02-20T02:26:38.118 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:26:37 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:26:37.983+0000 7fd292587640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T02:26:38.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:37 trial106 ceph-mon[44052]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-20T02:26:38.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:37 trial106 ceph-mon[44052]: osdmap e30: 6 total, 4 up, 6 in 2026-02-20T02:26:38.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:37 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:38.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:37 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:38.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:37 trial106 ceph-mon[44052]: from='osd.4 [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:38.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:37 trial106 ceph-mon[44052]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:38.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:37 trial098 ceph-mon[38923]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-20T02:26:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:37 trial098 ceph-mon[38923]: osdmap e30: 6 total, 4 up, 6 in 2026-02-20T02:26:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:37 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:37 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:37 trial098 ceph-mon[38923]: from='osd.4 [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:38.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:37 trial098 ceph-mon[38923]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:39.095 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:38 trial106 ceph-mon[44052]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T02:26:39.096 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:38 trial106 ceph-mon[44052]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial106", "root=default"]}]': finished 2026-02-20T02:26:39.096 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:38 trial106 ceph-mon[44052]: osdmap e31: 6 total, 4 up, 6 in 2026-02-20T02:26:39.096 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:38 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:39.096 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:38 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:39.096 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:38 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:38 trial098 ceph-mon[38923]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T02:26:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:38 trial098 ceph-mon[38923]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial106", "root=default"]}]': finished 2026-02-20T02:26:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:38 trial098 ceph-mon[38923]: osdmap e31: 6 total, 4 up, 6 in 2026-02-20T02:26:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:38 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:39.911 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: purged_snaps scrub starts 2026-02-20T02:26:39.911 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: purged_snaps scrub ok 2026-02-20T02:26:39.911 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: OSD bench result of 125532.093933 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-20T02:26:39.912 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: osd.4 [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] boot 2026-02-20T02:26:39.912 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: osdmap e32: 6 total, 5 up, 6 in 2026-02-20T02:26:39.912 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:39.912 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:39.912 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-20T02:26:39.912 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:39.912 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: osdmap e33: 6 total, 5 up, 6 in 2026-02-20T02:26:39.912 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:39 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:40.243 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: purged_snaps scrub starts 2026-02-20T02:26:40.243 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: purged_snaps scrub ok 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: OSD bench result of 125532.093933 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: osd.4 [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] boot 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: osdmap e32: 6 total, 5 up, 6 in 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: osdmap e33: 6 total, 5 up, 6 in 2026-02-20T02:26:40.244 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:39 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:41.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:40 trial106 ceph-mon[44052]: Deploying daemon osd.5 on trial106 2026-02-20T02:26:41.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:40 trial106 ceph-mon[44052]: pgmap v53: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T02:26:41.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:40 trial106 ceph-mon[44052]: osdmap e34: 6 total, 5 up, 6 in 2026-02-20T02:26:41.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:40 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:41.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:40 trial098 ceph-mon[38923]: Deploying daemon osd.5 on trial106 2026-02-20T02:26:41.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:40 trial098 ceph-mon[38923]: pgmap v53: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T02:26:41.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:40 trial098 ceph-mon[38923]: osdmap e34: 6 total, 5 up, 6 in 2026-02-20T02:26:41.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:40 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:42.091 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:41 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:42.092 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:41 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.092 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:41 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:41 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:42.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:41 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:41 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.648 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.645+0000 7f1644ff9640 1 -- 10.20.193.106:0/1747465498 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f16481104a0 con 0x7f161c0775a0 2026-02-20T02:26:42.648 INFO:teuthology.orchestra.run.trial106.stdout:Created osd(s) 5 on host 'trial106' 2026-02-20T02:26:42.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f161c0775a0 msgr2=0x7f161c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:42.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f161c0775a0 0x7f161c079a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1634003920 tx=0x7f1634005f50 comp rx=0 tx=0).stop 2026-02-20T02:26:42.650 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 msgr2=0x7f16481a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:42.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 0x7f16481a0de0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1638009ae0 tx=0x7f1638002820 comp rx=0 tx=0).stop 2026-02-20T02:26:42.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 shutdown_connections 2026-02-20T02:26:42.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f161c0775a0 0x7f161c079a60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:42.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1648078cf0 0x7f16481a0de0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:42.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 --2- 10.20.193.106:0/1747465498 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1648077aa0 0x7f16481a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:42.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 >> 10.20.193.106:0/1747465498 conn(0x7f16481000b0 msgr2=0x7f164810ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:42.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 shutdown_connections 2026-02-20T02:26:42.651 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:42.647+0000 7f164dcbf640 1 -- 10.20.193.106:0/1747465498 wait complete. 2026-02-20T02:26:42.686 DEBUG:teuthology.orchestra.run.trial106:osd.5> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.5.service 2026-02-20T02:26:42.688 INFO:tasks.cephadm:Deploying osd.6 on trial106 with /dev/vg_nvme/lv_2... 2026-02-20T02:26:42.689 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-20T02:26:42.860 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: pgmap v56: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T02:26:42.861 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.861 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.861 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:42.861 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:42.861 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.861 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:42.861 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.861 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:42 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:42.899 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:26:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: pgmap v56: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T02:26:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:43.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:43.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:43.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:43.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:42 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:43.618 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:26:43 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:26:43.570+0000 7fb18eba4740 -1 Falling back to public interface 2026-02-20T02:26:44.042 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:26:44.058 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch daemon add osd trial106:vg_nvme/lv_2 2026-02-20T02:26:44.216 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:26:44.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.321+0000 7f433deef640 1 -- 10.20.193.106:0/3995355545 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338078cf0 msgr2=0x7f4338079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:44.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.321+0000 7f433deef640 1 --2- 10.20.193.106:0/3995355545 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338078cf0 0x7f4338079150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43280099b0 tx=0x7f432802f220 comp rx=0 tx=0).stop 2026-02-20T02:26:44.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.321+0000 7f433deef640 1 -- 10.20.193.106:0/3995355545 shutdown_connections 2026-02-20T02:26:44.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.321+0000 7f433deef640 1 --2- 10.20.193.106:0/3995355545 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338078cf0 0x7f4338079150 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:44.326 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.321+0000 7f433deef640 1 --2- 10.20.193.106:0/3995355545 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4338077aa0 0x7f4338077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.321+0000 7f433deef640 1 -- 10.20.193.106:0/3995355545 >> 10.20.193.106:0/3995355545 conn(0x7f43381000b0 msgr2=0x7f43381024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.321+0000 7f433deef640 1 -- 10.20.193.106:0/3995355545 shutdown_connections 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f433deef640 1 -- 10.20.193.106:0/3995355545 wait complete. 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f433deef640 1 Processor -- start 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f433deef640 1 -- start start 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f433deef640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338077aa0 0x7f43381a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f433deef640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4338078cf0 0x7f43381a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f433deef640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f43381119a0 con 0x7f4338078cf0 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f433deef640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4338111820 con 0x7f4338077aa0 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f43377fe640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338077aa0 0x7f43381a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:44.327 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f43377fe640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338077aa0 0x7f43381a0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.106:3300/0 says I am v2:10.20.193.106:59334/0 (socket says 10.20.193.106:59334) 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f43377fe640 1 -- 10.20.193.106:0/3953552386 learned_addr learned my addr 10.20.193.106:0/3953552386 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f4336ffd640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4338078cf0 0x7f43381a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f43377fe640 1 -- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4338078cf0 msgr2=0x7f43381a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f43377fe640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4338078cf0 0x7f43381a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f43377fe640 1 -- 10.20.193.106:0/3953552386 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43381a1410 con 0x7f4338077aa0 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f43377fe640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338077aa0 0x7f43381a0850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f432400d8d0 tx=0x7f432400dda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f4334ff9640 1 -- 10.20.193.106:0/3953552386 <== mon.1 v2:10.20.193.106:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4324014070 con 0x7f4338077aa0 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.322+0000 7f4334ff9640 1 -- 10.20.193.106:0/3953552386 <== mon.1 v2:10.20.193.106:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f43240044a0 con 0x7f4338077aa0 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.323+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43381a5e50 con 0x7f4338077aa0 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.323+0000 7f4334ff9640 1 -- 10.20.193.106:0/3953552386 <== mon.1 v2:10.20.193.106:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4324002dc0 con 0x7f4338077aa0 2026-02-20T02:26:44.328 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.323+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43381a6380 con 0x7f4338077aa0 2026-02-20T02:26:44.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.323+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4338077ea0 con 0x7f4338077aa0 2026-02-20T02:26:44.329 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.324+0000 7f4334ff9640 1 -- 10.20.193.106:0/3953552386 <== mon.1 v2:10.20.193.106:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f432400b840 con 0x7f4338077aa0 2026-02-20T02:26:44.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.324+0000 7f4334ff9640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f430c0775a0 0x7f430c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:44.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.324+0000 7f4334ff9640 1 -- 10.20.193.106:0/3953552386 <== mon.1 v2:10.20.193.106:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4317+0+0 (secure 0 0 0) 0x7f43240993c0 con 0x7f4338077aa0 2026-02-20T02:26:44.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.324+0000 7f4336ffd640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f430c0775a0 0x7f430c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:44.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.325+0000 7f4336ffd640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f430c0775a0 0x7f430c079a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43280097c0 tx=0x7f432803a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:44.330 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.326+0000 7f4334ff9640 1 -- 10.20.193.106:0/3953552386 <== mon.1 v2:10.20.193.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4324066a30 con 0x7f4338077aa0 2026-02-20T02:26:44.415 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:44.413+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f43381104a0 con 0x7f430c0775a0 2026-02-20T02:26:44.603 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: Detected new or changed devices on trial106 2026-02-20T02:26:44.603 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:44.603 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:44.603 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:44.603 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:44.603 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial106 to 40935M 2026-02-20T02:26:44.603 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:44.604 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:44.604 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:44.604 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:44.604 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:44 trial106 ceph-mon[44052]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail; 102 KiB/s, 0 objects/s recovering 2026-02-20T02:26:44.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: Detected new or changed devices on trial106 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial106 to 40935M 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:44.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:44 trial098 ceph-mon[38923]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail; 102 KiB/s, 0 objects/s recovering 2026-02-20T02:26:45.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/3174897731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dbfc155-0624-4bb5-9a00-04227cdb859a"}]: dispatch 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dbfc155-0624-4bb5-9a00-04227cdb859a"}]: dispatch 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8dbfc155-0624-4bb5-9a00-04227cdb859a"}]': finished 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: osdmap e35: 7 total, 5 up, 7 in 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:45.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:45.566 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:45 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/1800965660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:45.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:45.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:45.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:45.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:45.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/3174897731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dbfc155-0624-4bb5-9a00-04227cdb859a"}]: dispatch 2026-02-20T02:26:45.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dbfc155-0624-4bb5-9a00-04227cdb859a"}]: dispatch 2026-02-20T02:26:45.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8dbfc155-0624-4bb5-9a00-04227cdb859a"}]': finished 2026-02-20T02:26:45.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: osdmap e35: 7 total, 5 up, 7 in 2026-02-20T02:26:45.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:45.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:45.619 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:45 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/1800965660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:46.700 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:46 trial106 ceph-mon[44052]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T02:26:46.701 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:26:46 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:26:46.590+0000 7fb18eba4740 -1 osd.5 0 log_to_monitors true 2026-02-20T02:26:46.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:46 trial098 ceph-mon[38923]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T02:26:47.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:47 trial098 ceph-mon[38923]: from='osd.5 [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T02:26:47.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:47 trial098 ceph-mon[38923]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T02:26:47.815 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:47 trial106 ceph-mon[44052]: from='osd.5 [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T02:26:47.815 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:47 trial106 ceph-mon[44052]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T02:26:48.675 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:26:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:26:48.392+0000 7fb18ab25640 -1 osd.5 0 waiting for initial osdmap 2026-02-20T02:26:48.676 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:26:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:26:48.395+0000 7fb18694f640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T02:26:48.676 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:48 trial106 ceph-mon[44052]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-20T02:26:48.676 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:48 trial106 ceph-mon[44052]: osdmap e36: 7 total, 5 up, 7 in 2026-02-20T02:26:48.676 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:48.676 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:48.676 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:48 trial106 ceph-mon[44052]: from='osd.5 [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:48.676 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:48 trial106 ceph-mon[44052]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:48.676 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:48 trial106 ceph-mon[44052]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 86 KiB/s, 0 objects/s recovering 2026-02-20T02:26:48.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:48 trial098 ceph-mon[38923]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-20T02:26:48.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:48 trial098 ceph-mon[38923]: osdmap e36: 7 total, 5 up, 7 in 2026-02-20T02:26:48.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:48.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:48.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:48 trial098 ceph-mon[38923]: from='osd.5 [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:48.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:48 trial098 ceph-mon[38923]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:48.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:48 trial098 ceph-mon[38923]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 86 KiB/s, 0 objects/s recovering 2026-02-20T02:26:49.494 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial106", "root=default"]}]': finished 2026-02-20T02:26:49.494 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: osdmap e37: 7 total, 5 up, 7 in 2026-02-20T02:26:49.494 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:49.494 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:49.494 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:49.494 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:26:49.494 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-20T02:26:49.495 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:49.495 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:49 trial106 ceph-mon[44052]: Deploying daemon osd.6 on trial106 2026-02-20T02:26:49.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial106", "root=default"]}]': finished 2026-02-20T02:26:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: osdmap e37: 7 total, 5 up, 7 in 2026-02-20T02:26:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:26:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-20T02:26:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:49.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:49 trial098 ceph-mon[38923]: Deploying daemon osd.6 on trial106 2026-02-20T02:26:50.584 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:50 trial106 ceph-mon[44052]: purged_snaps scrub starts 2026-02-20T02:26:50.584 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:50 trial106 ceph-mon[44052]: purged_snaps scrub ok 2026-02-20T02:26:50.584 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:50.584 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:50 trial106 ceph-mon[44052]: osd.5 [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] boot 2026-02-20T02:26:50.585 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:50 trial106 ceph-mon[44052]: osdmap e38: 7 total, 6 up, 7 in 2026-02-20T02:26:50.585 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:50.585 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:50 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:50.585 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:50 trial106 ceph-mon[44052]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T02:26:50.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:50 trial098 ceph-mon[38923]: purged_snaps scrub starts 2026-02-20T02:26:50.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:50 trial098 ceph-mon[38923]: purged_snaps scrub ok 2026-02-20T02:26:50.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:50.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:50 trial098 ceph-mon[38923]: osd.5 [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] boot 2026-02-20T02:26:50.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:50 trial098 ceph-mon[38923]: osdmap e38: 7 total, 6 up, 7 in 2026-02-20T02:26:50.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T02:26:50.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:50 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:50.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:50 trial098 ceph-mon[38923]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T02:26:51.641 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.639+0000 7f4334ff9640 1 -- 10.20.193.106:0/3953552386 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f43381104a0 con 0x7f430c0775a0 2026-02-20T02:26:51.641 INFO:teuthology.orchestra.run.trial106.stdout:Created osd(s) 6 on host 'trial106' 2026-02-20T02:26:51.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f430c0775a0 msgr2=0x7f430c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:51.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f430c0775a0 0x7f430c079a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43280097c0 tx=0x7f432803a040 comp rx=0 tx=0).stop 2026-02-20T02:26:51.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338077aa0 msgr2=0x7f43381a0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:51.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338077aa0 0x7f43381a0850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f432400d8d0 tx=0x7f432400dda0 comp rx=0 tx=0).stop 2026-02-20T02:26:51.643 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 shutdown_connections 2026-02-20T02:26:51.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f430c0775a0 0x7f430c079a60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:51.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4338078cf0 0x7f43381a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:51.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 --2- 10.20.193.106:0/3953552386 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4338077aa0 0x7f43381a0850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:51.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 >> 10.20.193.106:0/3953552386 conn(0x7f43381000b0 msgr2=0x7f433810ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:51.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 shutdown_connections 2026-02-20T02:26:51.644 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:51.641+0000 7f433deef640 1 -- 10.20.193.106:0/3953552386 wait complete. 2026-02-20T02:26:51.657 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: osdmap e39: 7 total, 6 up, 7 in 2026-02-20T02:26:51.657 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:51.657 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:51.657 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.658 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.658 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.658 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.658 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:51.658 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:51.658 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:51 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.678 DEBUG:teuthology.orchestra.run.trial106:osd.6> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.6.service 2026-02-20T02:26:51.680 INFO:tasks.cephadm:Deploying osd.7 on trial106 with /dev/vg_nvme/lv_1... 2026-02-20T02:26:51.681 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-20T02:26:51.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: osdmap e39: 7 total, 6 up, 7 in 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:51.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:51 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:51.895 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:26:52.616 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: osdmap e40: 7 total, 6 up, 7 in 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: pgmap v67: 1 pgs: 1 remapped; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:52.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:52.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:52.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:52.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:52 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:26:52 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:26:52.405+0000 7fc137a63740 -1 Falling back to public interface 2026-02-20T02:26:52.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: osdmap e40: 7 total, 6 up, 7 in 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: pgmap v67: 1 pgs: 1 remapped; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:26:52.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:52.816 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:52.816 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:26:52.816 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:52 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:26:53.080 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:26:53.096 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph orch daemon add osd trial106:vg_nvme/lv_1 2026-02-20T02:26:53.247 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:26:53.358 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 -- 10.20.193.106:0/4072285551 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 msgr2=0x7f6198105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 --2- 10.20.193.106:0/4072285551 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 0x7f6198105fb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f61800098e0 tx=0x7f618002f1d0 comp rx=0 tx=0).stop 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 -- 10.20.193.106:0/4072285551 shutdown_connections 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 --2- 10.20.193.106:0/4072285551 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 0x7f6198105fb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 --2- 10.20.193.106:0/4072285551 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6198104930 0x7f6198104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 -- 10.20.193.106:0/4072285551 >> 10.20.193.106:0/4072285551 conn(0x7f61981000c0 msgr2=0x7f6198102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 -- 10.20.193.106:0/4072285551 shutdown_connections 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 -- 10.20.193.106:0/4072285551 wait complete. 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 Processor -- start 2026-02-20T02:26:53.359 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 -- start start 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6198104930 0x7f619819c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 0x7f619819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f619810d4c0 con 0x7f6198104930 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.354+0000 7f619ce0f640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f619810d340 con 0x7f6198105b30 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f6195d74640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 0x7f619819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f6195d74640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 0x7f619819c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.106:3300/0 says I am v2:10.20.193.106:57696/0 (socket says 10.20.193.106:57696) 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f6195d74640 1 -- 10.20.193.106:0/3316350756 learned_addr learned my addr 10.20.193.106:0/3316350756 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f6196575640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6198104930 0x7f619819c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f6195d74640 1 -- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6198104930 msgr2=0x7f619819c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f6195d74640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6198104930 0x7f619819c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:26:53.360 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f6195d74640 1 -- 10.20.193.106:0/3316350756 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619819cef0 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f6195d74640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 0x7f619819c870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6180002410 tx=0x7f618002fd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f617f7fe640 1 -- 10.20.193.106:0/3316350756 <== mon.1 v2:10.20.193.106:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6180046070 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f617f7fe640 1 -- 10.20.193.106:0/3316350756 <== mon.1 v2:10.20.193.106:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6180004420 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f617f7fe640 1 -- 10.20.193.106:0/3316350756 <== mon.1 v2:10.20.193.106:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6180041630 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61981a18d0 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61981a1ee0 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.355+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6198104d30 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.356+0000 7f617f7fe640 1 -- 10.20.193.106:0/3316350756 <== mon.1 v2:10.20.193.106:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f6180038510 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.356+0000 7f617f7fe640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6170077550 0x7f6170079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.356+0000 7f617f7fe640 1 -- 10.20.193.106:0/3316350756 <== mon.1 v2:10.20.193.106:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4749+0+0 (secure 0 0 0) 0x7f618003e070 con 0x7f6198105b30 2026-02-20T02:26:53.361 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.357+0000 7f6196575640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6170077550 0x7f6170079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:26:53.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.357+0000 7f6196575640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6170077550 0x7f6170079a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6198105990 tx=0x7f618c009340 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:26:53.362 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.358+0000 7f617f7fe640 1 -- 10.20.193.106:0/3316350756 <== mon.1 v2:10.20.193.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6180050080 con 0x7f6198105b30 2026-02-20T02:26:53.447 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:26:53.446+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f61980630c0 con 0x7f6170077550 2026-02-20T02:26:53.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:53 trial106 ceph-mon[44052]: Detected new or changed devices on trial106 2026-02-20T02:26:53.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:53 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial106 to 27290M 2026-02-20T02:26:53.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:53 trial098 ceph-mon[38923]: Detected new or changed devices on trial106 2026-02-20T02:26:53.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:53 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial106 to 27290M 2026-02-20T02:26:54.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: pgmap v68: 1 pgs: 1 remapped; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/133421116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9b95d9-47be-4fb9-9796-8f9f75d14e61"}]: dispatch 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9b95d9-47be-4fb9-9796-8f9f75d14e61"}]: dispatch 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d9b95d9-47be-4fb9-9796-8f9f75d14e61"}]': finished 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: osdmap e41: 8 total, 6 up, 8 in 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:54.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:54 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/3444974175' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:54.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: pgmap v68: 1 pgs: 1 remapped; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/133421116' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9b95d9-47be-4fb9-9796-8f9f75d14e61"}]: dispatch 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9b95d9-47be-4fb9-9796-8f9f75d14e61"}]: dispatch 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d9b95d9-47be-4fb9-9796-8f9f75d14e61"}]': finished 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: osdmap e41: 8 total, 6 up, 8 in 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:54.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:54 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/3444974175' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T02:26:55.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:55 trial098 ceph-mon[38923]: from='osd.6 [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-20T02:26:55.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:55 trial098 ceph-mon[38923]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-20T02:26:55.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:55 trial106 ceph-mon[44052]: from='osd.6 [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-20T02:26:55.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:55 trial106 ceph-mon[44052]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-20T02:26:55.868 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:26:55 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:26:55.441+0000 7fc137a63740 -1 osd.6 0 log_to_monitors true 2026-02-20T02:26:56.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:56 trial098 ceph-mon[38923]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T02:26:56.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:56 trial098 ceph-mon[38923]: osdmap e42: 8 total, 6 up, 8 in 2026-02-20T02:26:56.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:56 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:56.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:56 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:56.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:56 trial098 ceph-mon[38923]: from='osd.6 [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:56.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:56 trial098 ceph-mon[38923]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:56.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:56 trial098 ceph-mon[38923]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 113 KiB/s, 0 objects/s recovering 2026-02-20T02:26:56.868 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:26:56 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:26:56.503+0000 7fc1339e4640 -1 osd.6 0 waiting for initial osdmap 2026-02-20T02:26:56.868 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:26:56 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:26:56.507+0000 7fc12f80e640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T02:26:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:56 trial106 ceph-mon[44052]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T02:26:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:56 trial106 ceph-mon[44052]: osdmap e42: 8 total, 6 up, 8 in 2026-02-20T02:26:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:56 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:56 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:56.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:56 trial106 ceph-mon[44052]: from='osd.6 [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:56.869 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:56 trial106 ceph-mon[44052]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:26:56.869 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:56 trial106 ceph-mon[44052]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 113 KiB/s, 0 objects/s recovering 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial106", "root=default"]}]': finished 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: osdmap e43: 8 total, 6 up, 8 in 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: osd.6 [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] boot 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: osdmap e44: 8 total, 7 up, 8 in 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:57.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:57 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:57.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial106", "root=default"]}]': finished 2026-02-20T02:26:57.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: osdmap e43: 8 total, 6 up, 8 in 2026-02-20T02:26:57.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:57.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:57.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:57.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: osd.6 [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] boot 2026-02-20T02:26:57.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: osdmap e44: 8 total, 7 up, 8 in 2026-02-20T02:26:57.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T02:26:57.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:57 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:58.756 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:58 trial106 ceph-mon[44052]: purged_snaps scrub starts 2026-02-20T02:26:58.756 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:58 trial106 ceph-mon[44052]: purged_snaps scrub ok 2026-02-20T02:26:58.756 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:58 trial106 ceph-mon[44052]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T02:26:58.756 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:58 trial106 ceph-mon[44052]: osdmap e45: 8 total, 7 up, 8 in 2026-02-20T02:26:58.756 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:58 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:58.756 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:58 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-20T02:26:58.756 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:58 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:58.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:58 trial098 ceph-mon[38923]: purged_snaps scrub starts 2026-02-20T02:26:58.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:58 trial098 ceph-mon[38923]: purged_snaps scrub ok 2026-02-20T02:26:58.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:58 trial098 ceph-mon[38923]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T02:26:58.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:58 trial098 ceph-mon[38923]: osdmap e45: 8 total, 7 up, 8 in 2026-02-20T02:26:58.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:58 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:58.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:58 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-20T02:26:58.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:58 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:26:59.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:59 trial098 ceph-mon[38923]: Deploying daemon osd.7 on trial106 2026-02-20T02:26:59.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:59 trial098 ceph-mon[38923]: osdmap e46: 8 total, 7 up, 8 in 2026-02-20T02:26:59.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:26:59 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:26:59.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:59 trial106 ceph-mon[44052]: Deploying daemon osd.7 on trial106 2026-02-20T02:26:59.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:59 trial106 ceph-mon[44052]: osdmap e46: 8 total, 7 up, 8 in 2026-02-20T02:26:59.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:26:59 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:00.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:00 trial098 ceph-mon[38923]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:00.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:00 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:00.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:00 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:00.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:00 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:00.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:00 trial106 ceph-mon[44052]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:00.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:00 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:00.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:00 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:00.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:00 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:01.054 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.052+0000 7f617f7fe640 1 -- 10.20.193.106:0/3316350756 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f61980630c0 con 0x7f6170077550 2026-02-20T02:27:01.054 INFO:teuthology.orchestra.run.trial106.stdout:Created osd(s) 7 on host 'trial106' 2026-02-20T02:27:01.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6170077550 msgr2=0x7f6170079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:01.056 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6170077550 0x7f6170079a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6198105990 tx=0x7f618c009340 comp rx=0 tx=0).stop 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 msgr2=0x7f619819c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 0x7f619819c870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6180002410 tx=0x7f618002fd40 comp rx=0 tx=0).stop 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 shutdown_connections 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f6170077550 0x7f6170079a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f6198105b30 0x7f619819c870 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 --2- 10.20.193.106:0/3316350756 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6198104930 0x7f619819c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 >> 10.20.193.106:0/3316350756 conn(0x7f61981000c0 msgr2=0x7f61981091e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 shutdown_connections 2026-02-20T02:27:01.057 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:01.054+0000 7f619ce0f640 1 -- 10.20.193.106:0/3316350756 wait complete. 2026-02-20T02:27:01.093 DEBUG:teuthology.orchestra.run.trial106:osd.7> sudo journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.7.service 2026-02-20T02:27:01.095 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2026-02-20T02:27:01.096 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T02:27:01.255 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:01.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 -- 10.20.193.98:0/2538423037 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 msgr2=0x7f5bf8107690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:01.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 --2- 10.20.193.98:0/2538423037 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 0x7f5bf8107690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5be80099b0 tx=0x7f5be802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:01.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 -- 10.20.193.98:0/2538423037 shutdown_connections 2026-02-20T02:27:01.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 --2- 10.20.193.98:0/2538423037 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5bf8107bd0 0x7f5bf8109fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 --2- 10.20.193.98:0/2538423037 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 0x7f5bf8107690 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 -- 10.20.193.98:0/2538423037 >> 10.20.193.98:0/2538423037 conn(0x7f5bf80fcd00 msgr2=0x7f5bf80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 -- 10.20.193.98:0/2538423037 shutdown_connections 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 -- 10.20.193.98:0/2538423037 wait complete. 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 Processor -- start 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 -- start start 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 0x7f5bf819c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5bf8107bd0 0x7f5bf819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf810d4e0 con 0x7f5bf806b810 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bff0f0640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf810d360 con 0x7f5bf8107bd0 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.359+0000 7f5bfce65640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 0x7f5bf819c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bfce65640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 0x7f5bf819c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:54966/0 (socket says 10.20.193.98:54966) 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bfce65640 1 -- 10.20.193.98:0/1015467251 learned_addr learned my addr 10.20.193.98:0/1015467251 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:01.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5beffff640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5bf8107bd0 0x7f5bf819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bfce65640 1 -- 10.20.193.98:0/1015467251 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5bf8107bd0 msgr2=0x7f5bf819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bfce65640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5bf8107bd0 0x7f5bf819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bfce65640 1 -- 10.20.193.98:0/1015467251 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf819cf10 con 0x7f5bf806b810 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bfce65640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 0x7f5bf819c350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5be8002410 tx=0x7f5be802fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bedffb640 1 -- 10.20.193.98:0/1015467251 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5be8004420 con 0x7f5bf806b810 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf81a18f0 con 0x7f5bf806b810 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bedffb640 1 -- 10.20.193.98:0/1015467251 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f5be8038a40 con 0x7f5bf806b810 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bedffb640 1 -- 10.20.193.98:0/1015467251 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5be80418e0 con 0x7f5bf806b810 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81a1f00 con 0x7f5bf806b810 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.360+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf8107690 con 0x7f5bf806b810 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.361+0000 7f5bedffb640 1 -- 10.20.193.98:0/1015467251 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f5be8038bf0 con 0x7f5bf806b810 2026-02-20T02:27:01.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.361+0000 7f5bedffb640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5bd40775a0 0x7f5bd4079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:01.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.361+0000 7f5bedffb640 1 -- 10.20.193.98:0/1015467251 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5181+0+0 (secure 0 0 0) 0x7f5be803e070 con 0x7f5bf806b810 2026-02-20T02:27:01.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.361+0000 7f5beffff640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5bd40775a0 0x7f5bd4079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:01.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.362+0000 7f5beffff640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5bd40775a0 0x7f5bd4079a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5be0005fd0 tx=0x7f5be0005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:01.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.363+0000 7f5bedffb640 1 -- 10.20.193.98:0/1015467251 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5be808b8e0 con 0x7f5bf806b810 2026-02-20T02:27:01.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.448+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5bf81a2190 con 0x7f5bf806b810 2026-02-20T02:27:01.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.448+0000 7f5bedffb640 1 -- 10.20.193.98:0/1015467251 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v46) ==== 74+0+130 (secure 0 0 0) 0x7f5be8090790 con 0x7f5bf806b810 2026-02-20T02:27:01.451 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:01.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5bd40775a0 msgr2=0x7f5bd4079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:01.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5bd40775a0 0x7f5bd4079a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5be0005fd0 tx=0x7f5be0005950 comp rx=0 tx=0).stop 2026-02-20T02:27:01.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 msgr2=0x7f5bf819c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:01.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 0x7f5bf819c350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5be8002410 tx=0x7f5be802fe10 comp rx=0 tx=0).stop 2026-02-20T02:27:01.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 shutdown_connections 2026-02-20T02:27:01.453 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5bd40775a0 0x7f5bd4079a60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.453 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5bf8107bd0 0x7f5bf819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.453 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 --2- 10.20.193.98:0/1015467251 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5bf806b810 0x7f5bf819c350 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:01.453 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 >> 10.20.193.98:0/1015467251 conn(0x7f5bf80fcd00 msgr2=0x7f5bf80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:01.453 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 shutdown_connections 2026-02-20T02:27:01.453 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:01.449+0000 7f5bff0f0640 1 -- 10.20.193.98:0/1015467251 wait complete. 2026-02-20T02:27:01.501 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":46,"num_osds":8,"num_up_osds":7,"osd_up_since":1771554417,"num_in_osds":8,"osd_in_since":1771554414,"num_remapped_pgs":0} 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1015467251' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:02.026 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:01 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.026 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:27:01 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:27:01.818+0000 7f6ad6053740 -1 Falling back to public interface 2026-02-20T02:27:02.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1015467251' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:27:02.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:27:02.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:27:02.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:27:02.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:02.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:02.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:01 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:02.502 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T02:27:02.660 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:02.766 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 -- 10.20.193.98:0/2706913415 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548104930 msgr2=0x7fb548104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:02.766 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 --2- 10.20.193.98:0/2706913415 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548104930 0x7fb548104d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5340099b0 tx=0x7fb53402f220 comp rx=0 tx=0).stop 2026-02-20T02:27:02.766 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 -- 10.20.193.98:0/2706913415 shutdown_connections 2026-02-20T02:27:02.766 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 --2- 10.20.193.98:0/2706913415 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb548105b30 0x7fb548105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:02.766 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 --2- 10.20.193.98:0/2706913415 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548104930 0x7fb548104d30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:02.766 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 -- 10.20.193.98:0/2706913415 >> 10.20.193.98:0/2706913415 conn(0x7fb5481000e0 msgr2=0x7fb548102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 -- 10.20.193.98:0/2706913415 shutdown_connections 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 -- 10.20.193.98:0/2706913415 wait complete. 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 Processor -- start 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 -- start start 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb548104930 0x7fb54819c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548105b30 0x7fb54819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb54810d4e0 con 0x7fb548105b30 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb54e21e640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb54810d360 con 0x7fb548104930 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb546ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548105b30 0x7fb54819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb546ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548105b30 0x7fb54819c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:54980/0 (socket says 10.20.193.98:54980) 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb546ffd640 1 -- 10.20.193.98:0/2207331502 learned_addr learned my addr 10.20.193.98:0/2207331502 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:02.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb5477fe640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb548104930 0x7fb54819c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb546ffd640 1 -- 10.20.193.98:0/2207331502 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb548104930 msgr2=0x7fb54819c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb546ffd640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb548104930 0x7fb54819c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb546ffd640 1 -- 10.20.193.98:0/2207331502 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54819cf10 con 0x7fb548105b30 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.761+0000 7fb546ffd640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548105b30 0x7fb54819c890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d900 tx=0x7fb53800ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.762+0000 7fb544ff9640 1 -- 10.20.193.98:0/2207331502 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb538014070 con 0x7fb548105b30 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.762+0000 7fb544ff9640 1 -- 10.20.193.98:0/2207331502 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb5380044a0 con 0x7fb548105b30 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.762+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5481a1950 con 0x7fb548105b30 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.762+0000 7fb544ff9640 1 -- 10.20.193.98:0/2207331502 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb538005020 con 0x7fb548105b30 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.762+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5481a1f60 con 0x7fb548105b30 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.762+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb548104d30 con 0x7fb548105b30 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.763+0000 7fb544ff9640 1 -- 10.20.193.98:0/2207331502 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fb5380047c0 con 0x7fb548105b30 2026-02-20T02:27:02.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.763+0000 7fb544ff9640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb51c077550 0x7fb51c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:02.769 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.763+0000 7fb544ff9640 1 -- 10.20.193.98:0/2207331502 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5181+0+0 (secure 0 0 0) 0x7fb538099aa0 con 0x7fb548105b30 2026-02-20T02:27:02.769 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.763+0000 7fb5477fe640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb51c077550 0x7fb51c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:02.769 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.763+0000 7fb5477fe640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb51c077550 0x7fb51c079a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb534002af0 tx=0x7fb53403a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:02.769 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.765+0000 7fb544ff9640 1 -- 10.20.193.98:0/2207331502 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb538066c70 con 0x7fb548105b30 2026-02-20T02:27:02.852 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.849+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb548195ca0 con 0x7fb548105b30 2026-02-20T02:27:02.852 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb544ff9640 1 -- 10.20.193.98:0/2207331502 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v46) ==== 74+0+130 (secure 0 0 0) 0x7fb53806bb20 con 0x7fb548105b30 2026-02-20T02:27:02.853 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:02.853 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb51c077550 msgr2=0x7fb51c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:02.853 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb51c077550 0x7fb51c079a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb534002af0 tx=0x7fb53403a040 comp rx=0 tx=0).stop 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548105b30 msgr2=0x7fb54819c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548105b30 0x7fb54819c890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d900 tx=0x7fb53800ddd0 comp rx=0 tx=0).stop 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 shutdown_connections 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb51c077550 0x7fb51c079a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb548105b30 0x7fb54819c890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 --2- 10.20.193.98:0/2207331502 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb548104930 0x7fb54819c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 >> 10.20.193.98:0/2207331502 conn(0x7fb5481000e0 msgr2=0x7fb548109270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.850+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 shutdown_connections 2026-02-20T02:27:02.854 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:02.851+0000 7fb54e21e640 1 -- 10.20.193.98:0/2207331502 wait complete. 2026-02-20T02:27:02.889 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":46,"num_osds":8,"num_up_osds":7,"osd_up_since":1771554417,"num_in_osds":8,"osd_in_since":1771554414,"num_remapped_pgs":0} 2026-02-20T02:27:03.101 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:02 trial098 ceph-mon[38923]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:03.101 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:02 trial098 ceph-mon[38923]: Detected new or changed devices on trial106 2026-02-20T02:27:03.102 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:02 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial106 to 20467M 2026-02-20T02:27:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:02 trial106 ceph-mon[44052]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:03.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:02 trial106 ceph-mon[44052]: Detected new or changed devices on trial106 2026-02-20T02:27:03.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:02 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial106 to 20467M 2026-02-20T02:27:03.890 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T02:27:04.048 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:04.091 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:03 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2207331502' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:04.091 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:27:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:03 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2207331502' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:04.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 -- 10.20.193.98:0/626480011 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 msgr2=0x7faf5c079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 --2- 10.20.193.98:0/626480011 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 0x7faf5c079150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf500099b0 tx=0x7faf5002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 -- 10.20.193.98:0/626480011 shutdown_connections 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 --2- 10.20.193.98:0/626480011 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 0x7faf5c079150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 --2- 10.20.193.98:0/626480011 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7faf5c077aa0 0x7faf5c077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 -- 10.20.193.98:0/626480011 >> 10.20.193.98:0/626480011 conn(0x7faf5c1000e0 msgr2=0x7faf5c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 -- 10.20.193.98:0/626480011 shutdown_connections 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 -- 10.20.193.98:0/626480011 wait complete. 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 Processor -- start 2026-02-20T02:27:04.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 -- start start 2026-02-20T02:27:04.155 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7faf5c077aa0 0x7faf5c1a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:04.155 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 0x7faf5c1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:04.155 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1119b0 con 0x7faf5c078cf0 2026-02-20T02:27:04.155 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf6459e640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c111830 con 0x7faf5c077aa0 2026-02-20T02:27:04.155 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf61b12640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 0x7faf5c1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf61b12640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 0x7faf5c1a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:54988/0 (socket says 10.20.193.98:54988) 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf61b12640 1 -- 10.20.193.98:0/1631991068 learned_addr learned my addr 10.20.193.98:0/1631991068 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf61b12640 1 -- 10.20.193.98:0/1631991068 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7faf5c077aa0 msgr2=0x7faf5c1a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf61b12640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7faf5c077aa0 0x7faf5c1a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf61b12640 1 -- 10.20.193.98:0/1631991068 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c1a1420 con 0x7faf5c078cf0 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf61b12640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 0x7faf5c1a0da0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf50009ae0 tx=0x7faf50002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.151+0000 7faf437fe640 1 -- 10.20.193.98:0/1631991068 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf500044e0 con 0x7faf5c078cf0 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.152+0000 7faf437fe640 1 -- 10.20.193.98:0/1631991068 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7faf50038a40 con 0x7faf5c078cf0 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.152+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c1a5e00 con 0x7faf5c078cf0 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.152+0000 7faf437fe640 1 -- 10.20.193.98:0/1631991068 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faf50041980 con 0x7faf5c078cf0 2026-02-20T02:27:04.156 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.152+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c1a6380 con 0x7faf5c078cf0 2026-02-20T02:27:04.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.152+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5c077ea0 con 0x7faf5c078cf0 2026-02-20T02:27:04.157 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.153+0000 7faf437fe640 1 -- 10.20.193.98:0/1631991068 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7faf500385d0 con 0x7faf5c078cf0 2026-02-20T02:27:04.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.153+0000 7faf437fe640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7faf380775a0 0x7faf38079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:04.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.153+0000 7faf437fe640 1 -- 10.20.193.98:0/1631991068 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5181+0+0 (secure 0 0 0) 0x7faf5003e070 con 0x7faf5c078cf0 2026-02-20T02:27:04.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.153+0000 7faf62313640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7faf380775a0 0x7faf38079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:04.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.154+0000 7faf62313640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7faf380775a0 0x7faf38079a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faf4c005fd0 tx=0x7faf4c005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:04.158 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.155+0000 7faf437fe640 1 -- 10.20.193.98:0/1631991068 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7faf5008b800 con 0x7faf5c078cf0 2026-02-20T02:27:04.241 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.238+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7faf5c19a3e0 con 0x7faf5c078cf0 2026-02-20T02:27:04.241 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.238+0000 7faf437fe640 1 -- 10.20.193.98:0/1631991068 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v46) ==== 74+0+130 (secure 0 0 0) 0x7faf500906b0 con 0x7faf5c078cf0 2026-02-20T02:27:04.241 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:04.242 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7faf380775a0 msgr2=0x7faf38079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:04.242 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7faf380775a0 0x7faf38079a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faf4c005fd0 tx=0x7faf4c005950 comp rx=0 tx=0).stop 2026-02-20T02:27:04.242 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 msgr2=0x7faf5c1a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:04.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 0x7faf5c1a0da0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf50009ae0 tx=0x7faf50002820 comp rx=0 tx=0).stop 2026-02-20T02:27:04.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 shutdown_connections 2026-02-20T02:27:04.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7faf380775a0 0x7faf38079a60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:04.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7faf5c078cf0 0x7faf5c1a0da0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:04.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 --2- 10.20.193.98:0/1631991068 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7faf5c077aa0 0x7faf5c1a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:04.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 >> 10.20.193.98:0/1631991068 conn(0x7faf5c1000e0 msgr2=0x7faf5c10f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:04.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 shutdown_connections 2026-02-20T02:27:04.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:04.239+0000 7faf6459e640 1 -- 10.20.193.98:0/1631991068 wait complete. 2026-02-20T02:27:04.277 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":46,"num_osds":8,"num_up_osds":7,"osd_up_since":1771554417,"num_in_osds":8,"osd_in_since":1771554414,"num_remapped_pgs":0} 2026-02-20T02:27:04.830 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:04 trial106 ceph-mon[44052]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:04.830 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:04 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1631991068' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:04.830 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:04 trial106 ceph-mon[44052]: from='osd.7 [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T02:27:04.831 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:04 trial106 ceph-mon[44052]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T02:27:04.831 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:27:04 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:27:04.546+0000 7f6ad6053740 -1 osd.7 0 log_to_monitors true 2026-02-20T02:27:05.278 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T02:27:05.303 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:04 trial098 ceph-mon[38923]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:05.304 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:04 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1631991068' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:05.304 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:04 trial098 ceph-mon[38923]: from='osd.7 [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T02:27:05.304 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:04 trial098 ceph-mon[38923]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T02:27:05.435 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:05.539 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 -- 10.20.193.98:0/3453050045 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0105b20 msgr2=0x7fd5e0105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:05.539 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 --2- 10.20.193.98:0/3453050045 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0105b20 0x7fd5e0105fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80099b0 tx=0x7fd5c802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:05.539 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 -- 10.20.193.98:0/3453050045 shutdown_connections 2026-02-20T02:27:05.539 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 --2- 10.20.193.98:0/3453050045 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0105b20 0x7fd5e0105fa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:05.539 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 --2- 10.20.193.98:0/3453050045 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd5e0104920 0x7fd5e0104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 -- 10.20.193.98:0/3453050045 >> 10.20.193.98:0/3453050045 conn(0x7fd5e01000b0 msgr2=0x7fd5e01024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 -- 10.20.193.98:0/3453050045 shutdown_connections 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 -- 10.20.193.98:0/3453050045 wait complete. 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 Processor -- start 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 -- start start 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0104920 0x7fd5e019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd5e0105b20 0x7fd5e019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e010d4b0 con 0x7fd5e0104920 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e7194640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e010d330 con 0x7fd5e0105b20 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e4f09640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0104920 0x7fd5e019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:05.540 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e4f09640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0104920 0x7fd5e019c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:54996/0 (socket says 10.20.193.98:54996) 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.535+0000 7fd5e4f09640 1 -- 10.20.193.98:0/3261086494 learned_addr learned my addr 10.20.193.98:0/3261086494 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5e4f09640 1 -- 10.20.193.98:0/3261086494 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd5e0105b20 msgr2=0x7fd5e019c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5e4f09640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd5e0105b20 0x7fd5e019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5e4f09640 1 -- 10.20.193.98:0/3261086494 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e019cec0 con 0x7fd5e0104920 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5e4f09640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0104920 0x7fd5e019c300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000d900 tx=0x7fd5d000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5d5ffb640 1 -- 10.20.193.98:0/3261086494 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd5d0014070 con 0x7fd5e0104920 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5d5ffb640 1 -- 10.20.193.98:0/3261086494 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fd5d00044a0 con 0x7fd5e0104920 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e01a1900 con 0x7fd5e0104920 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5d5ffb640 1 -- 10.20.193.98:0/3261086494 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd5d0002c40 con 0x7fd5e0104920 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e01a1f10 con 0x7fd5e0104920 2026-02-20T02:27:05.541 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.536+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e0104d20 con 0x7fd5e0104920 2026-02-20T02:27:05.542 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.537+0000 7fd5d5ffb640 1 -- 10.20.193.98:0/3261086494 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fd5d000b840 con 0x7fd5e0104920 2026-02-20T02:27:05.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.538+0000 7fd5d5ffb640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd5bc0775a0 0x7fd5bc079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:05.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.538+0000 7fd5d5ffb640 1 -- 10.20.193.98:0/3261086494 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5202+0+0 (secure 0 0 0) 0x7fd5d0099ca0 con 0x7fd5e0104920 2026-02-20T02:27:05.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.538+0000 7fd5d7fff640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd5bc0775a0 0x7fd5bc079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:05.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.538+0000 7fd5d7fff640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd5bc0775a0 0x7fd5bc079a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80097c0 tx=0x7fd5c80047c0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:05.543 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.539+0000 7fd5d5ffb640 1 -- 10.20.193.98:0/3261086494 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd5d0066f90 con 0x7fd5e0104920 2026-02-20T02:27:05.625 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.623+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd5e01a2200 con 0x7fd5e0104920 2026-02-20T02:27:05.625 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.623+0000 7fd5d5ffb640 1 -- 10.20.193.98:0/3261086494 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v47) ==== 74+0+130 (secure 0 0 0) 0x7fd5d006be40 con 0x7fd5e0104920 2026-02-20T02:27:05.626 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd5bc0775a0 msgr2=0x7fd5bc079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd5bc0775a0 0x7fd5bc079a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80097c0 tx=0x7fd5c80047c0 comp rx=0 tx=0).stop 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0104920 msgr2=0x7fd5e019c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0104920 0x7fd5e019c300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000d900 tx=0x7fd5d000ddd0 comp rx=0 tx=0).stop 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 shutdown_connections 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd5bc0775a0 0x7fd5bc079a60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd5e0105b20 0x7fd5e019c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 --2- 10.20.193.98:0/3261086494 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd5e0104920 0x7fd5e019c300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:05.627 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 >> 10.20.193.98:0/3261086494 conn(0x7fd5e01000b0 msgr2=0x7fd5e01024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:05.628 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 shutdown_connections 2026-02-20T02:27:05.628 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:05.624+0000 7fd5e7194640 1 -- 10.20.193.98:0/3261086494 wait complete. 2026-02-20T02:27:05.662 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":47,"num_osds":8,"num_up_osds":7,"osd_up_since":1771554417,"num_in_osds":8,"osd_in_since":1771554414,"num_remapped_pgs":0} 2026-02-20T02:27:06.003 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:05 trial098 ceph-mon[38923]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-20T02:27:06.004 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:05 trial098 ceph-mon[38923]: osdmap e47: 8 total, 7 up, 8 in 2026-02-20T02:27:06.004 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:05 trial098 ceph-mon[38923]: from='osd.7 [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:27:06.004 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:05 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:06.004 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:05 trial098 ceph-mon[38923]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:27:06.004 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:05 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3261086494' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:06.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:05 trial106 ceph-mon[44052]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-20T02:27:06.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:05 trial106 ceph-mon[44052]: osdmap e47: 8 total, 7 up, 8 in 2026-02-20T02:27:06.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:05 trial106 ceph-mon[44052]: from='osd.7 [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:27:06.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:05 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:06.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:05 trial106 ceph-mon[44052]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial106", "root=default"]}]: dispatch 2026-02-20T02:27:06.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:05 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/3261086494' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:06.119 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:27:05 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:27:05.840+0000 7f6ad1fd4640 -1 osd.7 0 waiting for initial osdmap 2026-02-20T02:27:06.119 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:27:05 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:27:05.843+0000 7f6acddfe640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T02:27:06.663 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T02:27:06.823 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:06.936 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 -- 10.20.193.98:0/2937503435 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 msgr2=0x7fa144105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:06.937 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 --2- 10.20.193.98:0/2937503435 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 0x7fa144105fa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa1340098e0 tx=0x7fa13402f1d0 comp rx=0 tx=0).stop 2026-02-20T02:27:06.937 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 -- 10.20.193.98:0/2937503435 shutdown_connections 2026-02-20T02:27:06.937 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 --2- 10.20.193.98:0/2937503435 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 0x7fa144105fa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:06.937 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 --2- 10.20.193.98:0/2937503435 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa144104920 0x7fa144104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:06.937 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 -- 10.20.193.98:0/2937503435 >> 10.20.193.98:0/2937503435 conn(0x7fa1441000b0 msgr2=0x7fa1441024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:06.937 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 -- 10.20.193.98:0/2937503435 shutdown_connections 2026-02-20T02:27:06.937 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 -- 10.20.193.98:0/2937503435 wait complete. 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 Processor -- start 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 -- start start 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa144104920 0x7fa14419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 0x7fa14419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa14410d4b0 con 0x7fa144105b20 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa14a0d5640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa14410d330 con 0x7fa144104920 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa142ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 0x7fa14419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa142ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 0x7fa14419c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:55018/0 (socket says 10.20.193.98:55018) 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.932+0000 7fa142ffd640 1 -- 10.20.193.98:0/4054820904 learned_addr learned my addr 10.20.193.98:0/4054820904 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa1437fe640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa144104920 0x7fa14419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa142ffd640 1 -- 10.20.193.98:0/4054820904 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa144104920 msgr2=0x7fa14419c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:06.938 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa142ffd640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa144104920 0x7fa14419c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa142ffd640 1 -- 10.20.193.98:0/4054820904 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14419cec0 con 0x7fa144105b20 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa142ffd640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 0x7fa14419c840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa134002410 tx=0x7fa13402ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa140ff9640 1 -- 10.20.193.98:0/4054820904 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa134046070 con 0x7fa144105b20 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa140ff9640 1 -- 10.20.193.98:0/4054820904 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa134004420 con 0x7fa144105b20 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1441a18a0 con 0x7fa144105b20 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa140ff9640 1 -- 10.20.193.98:0/4054820904 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa134041650 con 0x7fa144105b20 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1441a1eb0 con 0x7fa144105b20 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.933+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa144104d20 con 0x7fa144105b20 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.934+0000 7fa140ff9640 1 -- 10.20.193.98:0/4054820904 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fa134038510 con 0x7fa144105b20 2026-02-20T02:27:06.939 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.934+0000 7fa140ff9640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa1180775a0 0x7fa118079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:06.940 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.935+0000 7fa1437fe640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa1180775a0 0x7fa118079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:06.940 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.935+0000 7fa140ff9640 1 -- 10.20.193.98:0/4054820904 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5498+0+0 (secure 0 0 0) 0x7fa13403e070 con 0x7fa144105b20 2026-02-20T02:27:06.940 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.935+0000 7fa1437fe640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa1180775a0 0x7fa118079a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa130005fd0 tx=0x7fa130004420 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:06.940 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:06.936+0000 7fa140ff9640 1 -- 10.20.193.98:0/4054820904 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa134050080 con 0x7fa144105b20 2026-02-20T02:27:06.941 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:06 trial098 ceph-mon[38923]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:06.941 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:06 trial098 ceph-mon[38923]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial106", "root=default"]}]': finished 2026-02-20T02:27:06.941 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:06 trial098 ceph-mon[38923]: osdmap e48: 8 total, 7 up, 8 in 2026-02-20T02:27:06.941 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:06.941 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:06 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:07.021 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.018+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa1441a22b0 con 0x7fa144105b20 2026-02-20T02:27:07.022 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.019+0000 7fa140ff9640 1 -- 10.20.193.98:0/4054820904 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v49) ==== 74+0+130 (secure 0 0 0) 0x7fa13408b6f0 con 0x7fa144105b20 2026-02-20T02:27:07.022 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:07.023 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.019+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa1180775a0 msgr2=0x7fa118079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.023 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.019+0000 7fa14a0d5640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa1180775a0 0x7fa118079a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa130005fd0 tx=0x7fa130004420 comp rx=0 tx=0).stop 2026-02-20T02:27:07.023 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 msgr2=0x7fa14419c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.023 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 0x7fa14419c840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa134002410 tx=0x7fa13402ff90 comp rx=0 tx=0).stop 2026-02-20T02:27:07.023 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 shutdown_connections 2026-02-20T02:27:07.023 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa1180775a0 0x7fa118079a60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.024 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa144105b20 0x7fa14419c840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.024 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 --2- 10.20.193.98:0/4054820904 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa144104920 0x7fa14419c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.024 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 >> 10.20.193.98:0/4054820904 conn(0x7fa1441000b0 msgr2=0x7fa1441024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:07.024 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 shutdown_connections 2026-02-20T02:27:07.024 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.020+0000 7fa14a0d5640 1 -- 10.20.193.98:0/4054820904 wait complete. 2026-02-20T02:27:07.081 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1771554426,"num_in_osds":8,"osd_in_since":1771554414,"num_remapped_pgs":0} 2026-02-20T02:27:07.082 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T02:27:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:06 trial106 ceph-mon[44052]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:06 trial106 ceph-mon[44052]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial106", "root=default"]}]': finished 2026-02-20T02:27:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:06 trial106 ceph-mon[44052]: osdmap e48: 8 total, 7 up, 8 in 2026-02-20T02:27:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:07.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:06 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:07.234 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:07.343 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2468788059 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 msgr2=0x7fa8b0113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 --2- 10.20.193.98:0/2468788059 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 0x7fa8b0113280 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa8980099b0 tx=0x7fa89802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2468788059 shutdown_connections 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 --2- 10.20.193.98:0/2468788059 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 0x7fa8b0113280 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 --2- 10.20.193.98:0/2468788059 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa8b0077620 0x7fa8b0077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2468788059 >> 10.20.193.98:0/2468788059 conn(0x7fa8b0100620 msgr2=0x7fa8b0102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2468788059 shutdown_connections 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2468788059 wait complete. 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 Processor -- start 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 -- start start 2026-02-20T02:27:07.344 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa8b0077620 0x7fa8b01a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 0x7fa8b01a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b0116090 con 0x7fa8b0077f40 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8b4a19640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b0115f10 con 0x7fa8b0077620 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8add74640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 0x7fa8b01a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8add74640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 0x7fa8b01a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:55040/0 (socket says 10.20.193.98:55040) 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8add74640 1 -- 10.20.193.98:0/2568159556 learned_addr learned my addr 10.20.193.98:0/2568159556 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8add74640 1 -- 10.20.193.98:0/2568159556 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa8b0077620 msgr2=0x7fa8b01a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8add74640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa8b0077620 0x7fa8b01a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8add74640 1 -- 10.20.193.98:0/2568159556 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b01a5660 con 0x7fa8b0077f40 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8add74640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 0x7fa8b01a12d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa898009980 tx=0x7fa89802fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:07.345 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.339+0000 7fa8977fe640 1 -- 10.20.193.98:0/2568159556 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa898004420 con 0x7fa8b0077f40 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.340+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b01a58f0 con 0x7fa8b0077f40 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.340+0000 7fa8977fe640 1 -- 10.20.193.98:0/2568159556 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa898038a40 con 0x7fa8b0077f40 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.340+0000 7fa8977fe640 1 -- 10.20.193.98:0/2568159556 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa8980417e0 con 0x7fa8b0077f40 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.340+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b01a5e20 con 0x7fa8b0077f40 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.340+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b0078d60 con 0x7fa8b0077f40 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.341+0000 7fa8977fe640 1 -- 10.20.193.98:0/2568159556 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fa898038bf0 con 0x7fa8b0077f40 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.341+0000 7fa8977fe640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa888077550 0x7fa888079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.341+0000 7fa8977fe640 1 -- 10.20.193.98:0/2568159556 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5498+0+0 (secure 0 0 0) 0x7fa89803e070 con 0x7fa8b0077f40 2026-02-20T02:27:07.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.341+0000 7fa8ae575640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa888077550 0x7fa888079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:07.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.342+0000 7fa8ae575640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa888077550 0x7fa888079a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4005fd0 tx=0x7fa8a4005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:07.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.343+0000 7fa8977fe640 1 -- 10.20.193.98:0/2568159556 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa89808b7e0 con 0x7fa8b0077f40 2026-02-20T02:27:07.428 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.426+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8b01a60d0 con 0x7fa8b0077f40 2026-02-20T02:27:07.429 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8977fe640 1 -- 10.20.193.98:0/2568159556 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+13876 (secure 0 0 0) 0x7fa898090690 con 0x7fa8b0077f40 2026-02-20T02:27:07.430 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:07.430 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":49,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","created":"2026-02-20T02:24:56.142342+0000","modified":"2026-02-20T02:27:06.838718+0000","last_up_change":"2026-02-20T02:27:06.838718+0000","last_in_change":"2026-02-20T02:26:54.128339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T02:26:21.525878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69983772-bfd2-47c6-858b-c78a6ba6bbdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6802","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6803","nonce":3443765866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6804","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6805","nonce":3443765866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6808","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6809","nonce":3443765866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6806","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6807","nonce":3443765866}]},"public_addr":"10.20.193.98:6803/3443765866","cluster_addr":"10.20.193.98:6805/3443765866","heartbeat_back_addr":"10.20.193.98:6809/3443765866","heartbeat_front_addr":"10.20.193.98:6807/3443765866","state":["exists","up"]},{"osd":1,"uuid":"b4cad49e-fbde-4300-ba11-a955ab405675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6810","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6811","nonce":1242417476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6812","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6813","nonce":1242417476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6816","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6817","nonce":1242417476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6814","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6815","nonce":1242417476}]},"public_addr":"10.20.193.98:6811/1242417476","cluster_addr":"10.20.193.98:6813/1242417476","heartbeat_back_addr":"10.20.193.98:6817/1242417476","heartbeat_front_addr":"10.20.193.98:6815/1242417476","state":["exists","up"]},{"osd":2,"uuid":"7ec05305-8212-4015-b82a-66a1c330bff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6818","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6819","nonce":3521404611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6820","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6821","nonce":3521404611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6824","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6825","nonce":3521404611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6822","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6823","nonce":3521404611}]},"public_addr":"10.20.193.98:6819/3521404611","cluster_addr":"10.20.193.98:6821/3521404611","heartbeat_back_addr":"10.20.193.98:6825/3521404611","heartbeat_front_addr":"10.20.193.98:6823/3521404611","state":["exists","up"]},{"osd":3,"uuid":"62e618a0-0ca1-40e0-8beb-24b9d89ecfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6826","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6827","nonce":3887278641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6828","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6829","nonce":3887278641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6832","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6833","nonce":3887278641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6830","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6831","nonce":3887278641}]},"public_addr":"10.20.193.98:6827/3887278641","cluster_addr":"10.20.193.98:6829/3887278641","heartbeat_back_addr":"10.20.193.98:6833/3887278641","heartbeat_front_addr":"10.20.193.98:6831/3887278641","state":["exists","up"]},{"osd":4,"uuid":"35dfa3a0-e20f-407f-a124-753ef1241351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6800","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6801","nonce":458320702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6803","nonce":458320702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6807","nonce":458320702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6805","nonce":458320702}]},"public_addr":"10.20.193.106:6801/458320702","cluster_addr":"10.20.193.106:6803/458320702","heartbeat_back_addr":"10.20.193.106:6807/458320702","heartbeat_front_addr":"10.20.193.106:6805/458320702","state":["exists","up"]},{"osd":5,"uuid":"646d457d-9777-4425-a4c6-edb74643b7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6809","nonce":1544178256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6810","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6811","nonce":1544178256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6814","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6815","nonce":1544178256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6812","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6813","nonce":1544178256}]},"public_addr":"10.20.193.106:6809/1544178256","cluster_addr":"10.20.193.106:6811/1544178256","heartbeat_back_addr":"10.20.193.106:6815/1544178256","heartbeat_front_addr":"10.20.193.106:6813/1544178256","state":["exists","up"]},{"osd":6,"uuid":"8dbfc155-0624-4bb5-9a00-04227cdb859a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6816","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6817","nonce":3694375899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6818","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6819","nonce":3694375899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6822","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6823","nonce":3694375899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6820","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6821","nonce":3694375899}]},"public_addr":"10.20.193.106:6817/3694375899","cluster_addr":"10.20.193.106:6819/3694375899","heartbeat_back_addr":"10.20.193.106:6823/3694375899","heartbeat_front_addr":"10.20.193.106:6821/3694375899","state":["exists","up"]},{"osd":7,"uuid":"0d9b95d9-47be-4fb9-9796-8f9f75d14e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6824","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6825","nonce":3281087512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6826","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6827","nonce":3281087512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6830","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6831","nonce":3281087512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6828","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6829","nonce":3281087512}]},"public_addr":"10.20.193.106:6825/3281087512","cluster_addr":"10.20.193.106:6827/3281087512","heartbeat_back_addr":"10.20.193.106:6831/3281087512","heartbeat_front_addr":"10.20.193.106:6829/3281087512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:02.738489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:10.724666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:19.868177+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:29.070816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:37.618888+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:47.625118+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:56.407926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.98:0/2186036449":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6801/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/4072581924":"2026-02-21T02:25:05.975323+0000","10.20.193.98:0/757881106":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6800/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/180891152":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/494053877":"2026-02-21T02:25:05.975323+0000","10.20.193.98:0/635628968":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/433631514":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/3304232391":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6800/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:6800/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/3223427167":"2026-02-21T02:25:15.462934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa888077550 msgr2=0x7fa888079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8b4a19640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa888077550 0x7fa888079a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4005fd0 tx=0x7fa8a4005950 comp rx=0 tx=0).stop 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 msgr2=0x7fa8b01a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8b4a19640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 0x7fa8b01a12d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa898009980 tx=0x7fa89802fdf0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 shutdown_connections 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8b4a19640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa888077550 0x7fa888079a10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8b4a19640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa8b0077f40 0x7fa8b01a12d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.427+0000 7fa8b4a19640 1 --2- 10.20.193.98:0/2568159556 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa8b0077620 0x7fa8b01a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.431 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.428+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 >> 10.20.193.98:0/2568159556 conn(0x7fa8b0100620 msgr2=0x7fa8b01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:07.432 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.428+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 shutdown_connections 2026-02-20T02:27:07.432 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.428+0000 7fa8b4a19640 1 -- 10.20.193.98:0/2568159556 wait complete. 2026-02-20T02:27:07.466 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-20T02:26:21.525878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-20T02:27:07.467 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-20T02:27:07.621 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:07.729 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.724+0000 7f2bb06eb640 1 -- 10.20.193.98:0/3589897030 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba81013c0 msgr2=0x7f2ba81017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.729 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.724+0000 7f2bb06eb640 1 --2- 10.20.193.98:0/3589897030 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba81013c0 0x7f2ba81017a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b980099e0 tx=0x7f2b9802f260 comp rx=0 tx=0).stop 2026-02-20T02:27:07.729 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.724+0000 7f2bb06eb640 1 -- 10.20.193.98:0/3589897030 shutdown_connections 2026-02-20T02:27:07.729 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.724+0000 7f2bb06eb640 1 --2- 10.20.193.98:0/3589897030 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2ba8101ce0 0x7f2ba810ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.729 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.724+0000 7f2bb06eb640 1 --2- 10.20.193.98:0/3589897030 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba81013c0 0x7f2ba81017a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.729 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.724+0000 7f2bb06eb640 1 -- 10.20.193.98:0/3589897030 >> 10.20.193.98:0/3589897030 conn(0x7f2ba80fd230 msgr2=0x7f2ba80ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:07.729 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.724+0000 7f2bb06eb640 1 -- 10.20.193.98:0/3589897030 shutdown_connections 2026-02-20T02:27:07.729 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.724+0000 7f2bb06eb640 1 -- 10.20.193.98:0/3589897030 wait complete. 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bb06eb640 1 Processor -- start 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bb06eb640 1 -- start start 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bb06eb640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2ba81013c0 0x7f2ba81a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bb06eb640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba8101ce0 0x7f2ba81a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bb06eb640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba8111b70 con 0x7f2ba8101ce0 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bb06eb640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba81119f0 con 0x7f2ba81013c0 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2badc5f640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba8101ce0 0x7f2ba81a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2badc5f640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba8101ce0 0x7f2ba81a2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:55062/0 (socket says 10.20.193.98:55062) 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2badc5f640 1 -- 10.20.193.98:0/1526658177 learned_addr learned my addr 10.20.193.98:0/1526658177 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2badc5f640 1 -- 10.20.193.98:0/1526658177 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2ba81013c0 msgr2=0x7f2ba81a2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.730 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bae460640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2ba81013c0 0x7f2ba81a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2badc5f640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2ba81013c0 0x7f2ba81a2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2badc5f640 1 -- 10.20.193.98:0/1526658177 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba819c720 con 0x7f2ba8101ce0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bae460640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2ba81013c0 0x7f2ba81a2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2badc5f640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba8101ce0 0x7f2ba81a2b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00d8d0 tx=0x7f2b9c00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2b8f7fe640 1 -- 10.20.193.98:0/1526658177 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2b9c014070 con 0x7f2ba8101ce0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2b8f7fe640 1 -- 10.20.193.98:0/1526658177 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2b9c0044a0 con 0x7f2ba8101ce0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba819ca10 con 0x7f2ba8101ce0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2b8f7fe640 1 -- 10.20.193.98:0/1526658177 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2b9c002dc0 con 0x7f2ba8101ce0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.725+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba819cf70 con 0x7f2ba8101ce0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.726+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba806b580 con 0x7f2ba8101ce0 2026-02-20T02:27:07.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.727+0000 7f2b8f7fe640 1 -- 10.20.193.98:0/1526658177 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f2b9c00b840 con 0x7f2ba8101ce0 2026-02-20T02:27:07.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.727+0000 7f2b8f7fe640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f2b84077550 0x7f2b84079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:07.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.727+0000 7f2b8f7fe640 1 -- 10.20.193.98:0/1526658177 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5498+0+0 (secure 0 0 0) 0x7f2b9c099a60 con 0x7f2ba8101ce0 2026-02-20T02:27:07.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.727+0000 7f2bae460640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f2b84077550 0x7f2b84079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:07.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.727+0000 7f2bae460640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f2b84077550 0x7f2b84079a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b98004870 tx=0x7f2b980047c0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:07.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.729+0000 7f2b8f7fe640 1 -- 10.20.193.98:0/1526658177 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2b9c066b90 con 0x7f2ba8101ce0 2026-02-20T02:27:07.816 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.813+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ba819d1d0 con 0x7f2ba8101ce0 2026-02-20T02:27:07.816 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.814+0000 7f2b8f7fe640 1 -- 10.20.193.98:0/1526658177 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7f2b9c06ba40 con 0x7f2ba8101ce0 2026-02-20T02:27:07.816 INFO:teuthology.orchestra.run.trial098.stdout:pg_num: 1 2026-02-20T02:27:07.817 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.814+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f2b84077550 msgr2=0x7f2b84079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.817 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.814+0000 7f2bb06eb640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f2b84077550 0x7f2b84079a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b98004870 tx=0x7f2b980047c0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.817 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.814+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba8101ce0 msgr2=0x7f2ba81a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:07.817 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.814+0000 7f2bb06eb640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba8101ce0 0x7f2ba81a2b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00d8d0 tx=0x7f2b9c00dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.818 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.815+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 shutdown_connections 2026-02-20T02:27:07.818 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.815+0000 7f2bb06eb640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f2b84077550 0x7f2b84079a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.818 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.815+0000 7f2bb06eb640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2ba8101ce0 0x7f2ba81a2b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.818 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.815+0000 7f2bb06eb640 1 --2- 10.20.193.98:0/1526658177 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2ba81013c0 0x7f2ba81a2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:07.818 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.815+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 >> 10.20.193.98:0/1526658177 conn(0x7f2ba80fd230 msgr2=0x7f2ba80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:07.818 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.815+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 shutdown_connections 2026-02-20T02:27:07.818 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:07.815+0000 7f2bb06eb640 1 -- 10.20.193.98:0/1526658177 wait complete. 2026-02-20T02:27:07.855 INFO:tasks.cephadm:Setting up client nodes... 2026-02-20T02:27:07.856 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-20T02:27:08.010 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:08.068 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: purged_snaps scrub starts 2026-02-20T02:27:08.068 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: purged_snaps scrub ok 2026-02-20T02:27:08.068 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:08.069 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: osd.7 [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] boot 2026-02-20T02:27:08.069 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: osdmap e49: 8 total, 8 up, 8 in 2026-02-20T02:27:08.069 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:08.069 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4054820904' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:08.069 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2568159556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:08.069 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:07 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1526658177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T02:27:08.119 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.114+0000 7f19fe385640 1 -- 10.20.193.98:0/2015766841 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8105b20 msgr2=0x7f19f8105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:08.119 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.114+0000 7f19fe385640 1 --2- 10.20.193.98:0/2015766841 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8105b20 0x7f19f8105fa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f19e80099b0 tx=0x7f19e802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:08.119 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.114+0000 7f19fe385640 1 -- 10.20.193.98:0/2015766841 shutdown_connections 2026-02-20T02:27:08.119 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.114+0000 7f19fe385640 1 --2- 10.20.193.98:0/2015766841 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8105b20 0x7f19f8105fa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.119 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.114+0000 7f19fe385640 1 --2- 10.20.193.98:0/2015766841 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f19f8104920 0x7f19f8104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.119 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.114+0000 7f19fe385640 1 -- 10.20.193.98:0/2015766841 >> 10.20.193.98:0/2015766841 conn(0x7f19f81000b0 msgr2=0x7f19f81024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:08.119 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.114+0000 7f19fe385640 1 -- 10.20.193.98:0/2015766841 shutdown_connections 2026-02-20T02:27:08.119 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.114+0000 7f19fe385640 1 -- 10.20.193.98:0/2015766841 wait complete. 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19fe385640 1 Processor -- start 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19fe385640 1 -- start start 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19fe385640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8104920 0x7f19f819c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19fe385640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f19f8105b20 0x7f19f819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19fe385640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f19f810d4b0 con 0x7f19f8104920 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19fe385640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f19f810d330 con 0x7f19f8105b20 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8104920 0x7f19f819c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8104920 0x7f19f819c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44214/0 (socket says 10.20.193.98:44214) 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f7fff640 1 -- 10.20.193.98:0/3882255511 learned_addr learned my addr 10.20.193.98:0/3882255511 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f77fe640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f19f8105b20 0x7f19f819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:08.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f7fff640 1 -- 10.20.193.98:0/3882255511 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f19f8105b20 msgr2=0x7f19f819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f7fff640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f19f8105b20 0x7f19f819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f7fff640 1 -- 10.20.193.98:0/3882255511 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f819cee0 con 0x7f19f8104920 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f77fe640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f19f8105b20 0x7f19f819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f7fff640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8104920 0x7f19f819c320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f19e400d900 tx=0x7f19e400ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f57fa640 1 -- 10.20.193.98:0/3882255511 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f19e4014070 con 0x7f19f8104920 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f57fa640 1 -- 10.20.193.98:0/3882255511 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f19e40044a0 con 0x7f19f8104920 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f81a1920 con 0x7f19f8104920 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19f57fa640 1 -- 10.20.193.98:0/3882255511 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f19e4002c40 con 0x7f19f8104920 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.115+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f81a1f30 con 0x7f19f8104920 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.116+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f8104d20 con 0x7f19f8104920 2026-02-20T02:27:08.121 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.117+0000 7f19f57fa640 1 -- 10.20.193.98:0/3882255511 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f19e400b840 con 0x7f19f8104920 2026-02-20T02:27:08.122 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: purged_snaps scrub starts 2026-02-20T02:27:08.122 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: purged_snaps scrub ok 2026-02-20T02:27:08.122 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:08.122 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: osd.7 [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] boot 2026-02-20T02:27:08.123 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: osdmap e49: 8 total, 8 up, 8 in 2026-02-20T02:27:08.123 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T02:27:08.123 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4054820904' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T02:27:08.123 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2568159556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:08.123 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:07 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1526658177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T02:27:08.123 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.117+0000 7f19f57fa640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19cc0775a0 0x7f19cc079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:08.124 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.117+0000 7f19f77fe640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19cc0775a0 0x7f19cc079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:08.124 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.117+0000 7f19f57fa640 1 -- 10.20.193.98:0/3882255511 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f19e4099ac0 con 0x7f19f8104920 2026-02-20T02:27:08.124 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.117+0000 7f19f77fe640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19cc0775a0 0x7f19cc079a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19e80097c0 tx=0x7f19e8005c70 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:08.124 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.119+0000 7f19f57fa640 1 -- 10.20.193.98:0/3882255511 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f19e4066b50 con 0x7f19f8104920 2026-02-20T02:27:08.235 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.233+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f19f8195c70 con 0x7f19f8104920 2026-02-20T02:27:08.237 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19f57fa640 1 -- 10.20.193.98:0/3882255511 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) ==== 170+0+59 (secure 0 0 0) 0x7f19e406ba00 con 0x7f19f8104920 2026-02-20T02:27:08.237 INFO:teuthology.orchestra.run.trial098.stdout:[client.0] 2026-02-20T02:27:08.237 INFO:teuthology.orchestra.run.trial098.stdout: key = AQB8xpdpo5oMDhAAXkT/0WoKluWuW3qURJi/IA== 2026-02-20T02:27:08.238 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19cc0775a0 msgr2=0x7f19cc079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:08.238 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19cc0775a0 0x7f19cc079a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19e80097c0 tx=0x7f19e8005c70 comp rx=0 tx=0).stop 2026-02-20T02:27:08.238 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8104920 msgr2=0x7f19f819c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:08.238 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8104920 0x7f19f819c320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f19e400d900 tx=0x7f19e400ddd0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.238 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 shutdown_connections 2026-02-20T02:27:08.238 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19cc0775a0 0x7f19cc079a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.239 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f19f8105b20 0x7f19f819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.239 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 --2- 10.20.193.98:0/3882255511 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f19f8104920 0x7f19f819c320 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.239 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 >> 10.20.193.98:0/3882255511 conn(0x7f19f81000b0 msgr2=0x7f19f81091d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:08.239 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 shutdown_connections 2026-02-20T02:27:08.239 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:08.235+0000 7f19fe385640 1 -- 10.20.193.98:0/3882255511 wait complete. 2026-02-20T02:27:08.273 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:27:08.273 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-20T02:27:08.273 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T02:27:08.309 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-20T02:27:08.465 INFO:teuthology.orchestra.run.trial106.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial106/config 2026-02-20T02:27:08.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.573+0000 7f8743d9c640 1 -- 10.20.193.106:0/2836579715 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c077aa0 msgr2=0x7f873c077ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:08.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.573+0000 7f8743d9c640 1 --2- 10.20.193.106:0/2836579715 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c077aa0 0x7f873c077ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f872c0099b0 tx=0x7f872c02f220 comp rx=0 tx=0).stop 2026-02-20T02:27:08.578 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.573+0000 7f8743d9c640 1 -- 10.20.193.106:0/2836579715 shutdown_connections 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.573+0000 7f8743d9c640 1 --2- 10.20.193.106:0/2836579715 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f873c078cf0 0x7f873c079150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.573+0000 7f8743d9c640 1 --2- 10.20.193.106:0/2836579715 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c077aa0 0x7f873c077ea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.573+0000 7f8743d9c640 1 -- 10.20.193.106:0/2836579715 >> 10.20.193.106:0/2836579715 conn(0x7f873c1000b0 msgr2=0x7f873c1024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.573+0000 7f8743d9c640 1 -- 10.20.193.106:0/2836579715 shutdown_connections 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.573+0000 7f8743d9c640 1 -- 10.20.193.106:0/2836579715 wait complete. 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8743d9c640 1 Processor -- start 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8743d9c640 1 -- start start 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8743d9c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f873c077aa0 0x7f873c1a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8743d9c640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c078cf0 0x7f873c1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8743d9c640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f873c1119a0 con 0x7f873c077aa0 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8743d9c640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f873c111820 con 0x7f873c078cf0 2026-02-20T02:27:08.579 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8741310640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c078cf0 0x7f873c1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8741310640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c078cf0 0x7f873c1a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.106:3300/0 says I am v2:10.20.193.106:46120/0 (socket says 10.20.193.106:46120) 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8741310640 1 -- 10.20.193.106:0/322961564 learned_addr learned my addr 10.20.193.106:0/322961564 (peer_addr_for_me v2:10.20.193.106:0/0) 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8741b11640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f873c077aa0 0x7f873c1a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8741310640 1 -- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f873c077aa0 msgr2=0x7f873c1a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8741310640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f873c077aa0 0x7f873c1a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8741310640 1 -- 10.20.193.106:0/322961564 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873c1a13d0 con 0x7f873c078cf0 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8741310640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c078cf0 0x7f873c1a0d50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f873000d8d0 tx=0x7f873000dda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f872affd640 1 -- 10.20.193.106:0/322961564 <== mon.1 v2:10.20.193.106:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8730014070 con 0x7f873c078cf0 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f872affd640 1 -- 10.20.193.106:0/322961564 <== mon.1 v2:10.20.193.106:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f87300044a0 con 0x7f873c078cf0 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f872affd640 1 -- 10.20.193.106:0/322961564 <== mon.1 v2:10.20.193.106:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8730002dc0 con 0x7f873c078cf0 2026-02-20T02:27:08.580 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873c1a5e10 con 0x7f873c078cf0 2026-02-20T02:27:08.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.574+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873c1a6390 con 0x7f873c078cf0 2026-02-20T02:27:08.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.575+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f873c077ea0 con 0x7f873c078cf0 2026-02-20T02:27:08.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.575+0000 7f872affd640 1 -- 10.20.193.106:0/322961564 <== mon.1 v2:10.20.193.106:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f873000b840 con 0x7f873c078cf0 2026-02-20T02:27:08.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.576+0000 7f872affd640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f87180775a0 0x7f8718079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:08.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.576+0000 7f872affd640 1 -- 10.20.193.106:0/322961564 <== mon.1 v2:10.20.193.106:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f8730099960 con 0x7f873c078cf0 2026-02-20T02:27:08.581 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.576+0000 7f8741b11640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f87180775a0 0x7f8718079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:08.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.576+0000 7f8741b11640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f87180775a0 0x7f8718079a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c03a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:08.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.578+0000 7f872affd640 1 -- 10.20.193.106:0/322961564 <== mon.1 v2:10.20.193.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f87300669f0 con 0x7f873c078cf0 2026-02-20T02:27:08.694 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.691+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f873c063880 con 0x7f873c078cf0 2026-02-20T02:27:08.697 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.694+0000 7f872affd640 1 -- 10.20.193.106:0/322961564 <== mon.1 v2:10.20.193.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) ==== 170+0+59 (secure 0 0 0) 0x7f873006b8a0 con 0x7f873c078cf0 2026-02-20T02:27:08.697 INFO:teuthology.orchestra.run.trial106.stdout:[client.1] 2026-02-20T02:27:08.697 INFO:teuthology.orchestra.run.trial106.stdout: key = AQB8xpdp2slcKRAAZfaXCrTV4KAh6e1jaLAZuA== 2026-02-20T02:27:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f87180775a0 msgr2=0x7f8718079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f87180775a0 0x7f8718079a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c03a040 comp rx=0 tx=0).stop 2026-02-20T02:27:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c078cf0 msgr2=0x7f873c1a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c078cf0 0x7f873c1a0d50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f873000d8d0 tx=0x7f873000dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.698 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 shutdown_connections 2026-02-20T02:27:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f87180775a0 0x7f8718079a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f873c078cf0 0x7f873c1a0d50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 --2- 10.20.193.106:0/322961564 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f873c077aa0 0x7f873c1a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 >> 10.20.193.106:0/322961564 conn(0x7f873c1000b0 msgr2=0x7f873c10f260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 shutdown_connections 2026-02-20T02:27:08.699 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:08.695+0000 7f8743d9c640 1 -- 10.20.193.106:0/322961564 wait complete. 2026-02-20T02:27:08.745 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:27:08.746 DEBUG:teuthology.orchestra.run.trial106:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-20T02:27:08.746 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-20T02:27:08.781 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T02:27:08.781 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-20T02:27:08.782 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-20T02:27:08.935 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:09.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 -- 10.20.193.98:0/4041972791 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075d30 msgr2=0x7f9de810ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 --2- 10.20.193.98:0/4041972791 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075d30 0x7f9de810ea40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0099b0 tx=0x7f9ddc02f2b0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 -- 10.20.193.98:0/4041972791 shutdown_connections 2026-02-20T02:27:09.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 --2- 10.20.193.98:0/4041972791 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075d30 0x7f9de810ea40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 --2- 10.20.193.98:0/4041972791 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9de8075410 0x7f9de80757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 -- 10.20.193.98:0/4041972791 >> 10.20.193.98:0/4041972791 conn(0x7f9de80fe360 msgr2=0x7f9de8100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:09.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 -- 10.20.193.98:0/4041972791 shutdown_connections 2026-02-20T02:27:09.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 -- 10.20.193.98:0/4041972791 wait complete. 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 Processor -- start 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.038+0000 7f9defd8f640 1 -- start start 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9defd8f640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075410 0x7f9de81a2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9defd8f640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9de8075d30 0x7f9de81a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9defd8f640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8111af0 con 0x7f9de8075410 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9defd8f640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8111970 con 0x7f9de8075d30 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dedb04640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075410 0x7f9de81a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dedb04640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075410 0x7f9de81a2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44234/0 (socket says 10.20.193.98:44234) 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dedb04640 1 -- 10.20.193.98:0/4203543654 learned_addr learned my addr 10.20.193.98:0/4203543654 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9ded303640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9de8075d30 0x7f9de81a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.045 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dedb04640 1 -- 10.20.193.98:0/4203543654 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9de8075d30 msgr2=0x7f9de81a2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dedb04640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9de8075d30 0x7f9de81a2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dedb04640 1 -- 10.20.193.98:0/4203543654 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de819c640 con 0x7f9de8075410 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9ded303640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9de8075d30 0x7f9de81a2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dedb04640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075410 0x7f9de81a2570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800ca30 tx=0x7f9dd800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dd6ffd640 1 -- 10.20.193.98:0/4203543654 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9dd8013070 con 0x7f9de8075410 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dd6ffd640 1 -- 10.20.193.98:0/4203543654 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9dd8007da0 con 0x7f9de8075410 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de819c930 con 0x7f9de8075410 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9dd6ffd640 1 -- 10.20.193.98:0/4203543654 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9dd8002e20 con 0x7f9de8075410 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.039+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de819cec0 con 0x7f9de8075410 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.040+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de8076b50 con 0x7f9de8075410 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.040+0000 7f9dd6ffd640 1 -- 10.20.193.98:0/4203543654 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f9dd8007930 con 0x7f9de8075410 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.040+0000 7f9dd6ffd640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dc4077550 0x7f9dc4079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.046 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.041+0000 7f9dd6ffd640 1 -- 10.20.193.98:0/4203543654 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f9dd8099c90 con 0x7f9de8075410 2026-02-20T02:27:09.047 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.041+0000 7f9ded303640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dc4077550 0x7f9dc4079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.047 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.041+0000 7f9ded303640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dc4077550 0x7f9dc4079a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0097c0 tx=0x7f9ddc0059d0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:09.047 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.043+0000 7f9dd6ffd640 1 -- 10.20.193.98:0/4203543654 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9dd8004440 con 0x7f9de8075410 2026-02-20T02:27:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:08 trial098 ceph-mon[38923]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:08 trial098 ceph-mon[38923]: osdmap e50: 8 total, 8 up, 8 in 2026-02-20T02:27:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:08 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3882255511' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T02:27:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:08 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3882255511' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T02:27:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:08 trial098 ceph-mon[38923]: from='client.? 10.20.193.106:0/322961564' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T02:27:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:08 trial098 ceph-mon[38923]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T02:27:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:08 trial098 ceph-mon[38923]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T02:27:09.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:08 trial106 ceph-mon[44052]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T02:27:09.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:08 trial106 ceph-mon[44052]: osdmap e50: 8 total, 8 up, 8 in 2026-02-20T02:27:09.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:08 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/3882255511' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T02:27:09.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:08 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/3882255511' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T02:27:09.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:08 trial106 ceph-mon[44052]: from='client.? 10.20.193.106:0/322961564' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T02:27:09.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:08 trial106 ceph-mon[44052]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T02:27:09.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:08 trial106 ceph-mon[44052]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T02:27:09.153 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.151+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9de819d1d0 con 0x7f9de8075410 2026-02-20T02:27:09.155 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.153+0000 7f9dd6ffd640 1 -- 10.20.193.98:0/4203543654 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+192101 (secure 0 0 0) 0x7f9dd8066e60 con 0x7f9de8075410 2026-02-20T02:27:09.159 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dc4077550 msgr2=0x7f9dc4079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dc4077550 0x7f9dc4079a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0097c0 tx=0x7f9ddc0059d0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075410 msgr2=0x7f9de81a2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075410 0x7f9de81a2570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800ca30 tx=0x7f9dd800cf00 comp rx=0 tx=0).stop 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 shutdown_connections 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dc4077550 0x7f9dc4079a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9de8075d30 0x7f9de81a2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 --2- 10.20.193.98:0/4203543654 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9de8075410 0x7f9de81a2570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.162 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 >> 10.20.193.98:0/4203543654 conn(0x7f9de80fe360 msgr2=0x7f9de8106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:09.163 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 shutdown_connections 2026-02-20T02:27:09.163 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.155+0000 7f9defd8f640 1 -- 10.20.193.98:0/4203543654 wait complete. 2026-02-20T02:27:09.197 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":19,"flags":0,"active_gid":14205,"active_name":"trial098.hiicxh","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6800","nonce":4172434185},{"type":"v1","addr":"10.20.193.98:6801","nonce":4172434185}]},"active_addr":"10.20.193.98:6801/4172434185","active_change":"2026-02-20T02:25:33.491384+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14226,"name":"trial106.gehstk","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.98:8443/","prometheus":"http://10.20.193.98:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.98:0","nonce":1628334706}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.98:0","nonce":1494816612}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.98:0","nonce":4045087981}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.98:0","nonce":682443580}]}]} 2026-02-20T02:27:09.205 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-20T02:27:09.206 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-20T02:27:09.206 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T02:27:09.360 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:09.470 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 -- 10.20.193.98:0/3054683786 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0075950 msgr2=0x7f3fd0075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.470 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 --2- 10.20.193.98:0/3054683786 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0075950 0x7f3fd0075d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00099e0 tx=0x7f3fc002f2f0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.470 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 -- 10.20.193.98:0/3054683786 shutdown_connections 2026-02-20T02:27:09.470 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 --2- 10.20.193.98:0/3054683786 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0075950 0x7f3fd0075d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.470 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 --2- 10.20.193.98:0/3054683786 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3fd0106510 0x7f3fd0075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.470 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 -- 10.20.193.98:0/3054683786 >> 10.20.193.98:0/3054683786 conn(0x7f3fd00fe360 msgr2=0x7f3fd0100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 -- 10.20.193.98:0/3054683786 shutdown_connections 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 -- 10.20.193.98:0/3054683786 wait complete. 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 Processor -- start 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.465+0000 7f3fd6458640 1 -- start start 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fd6458640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3fd0075950 0x7f3fd01a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fd6458640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0106510 0x7f3fd01a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fd6458640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0116000 con 0x7f3fd0106510 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fd6458640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0115e80 con 0x7f3fd0075950 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcf7fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0106510 0x7f3fd01a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcf7fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0106510 0x7f3fd01a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44260/0 (socket says 10.20.193.98:44260) 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcf7fe640 1 -- 10.20.193.98:0/2175004478 learned_addr learned my addr 10.20.193.98:0/2175004478 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:09.471 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcffff640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3fd0075950 0x7f3fd01a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcf7fe640 1 -- 10.20.193.98:0/2175004478 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3fd0075950 msgr2=0x7f3fd01a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcf7fe640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3fd0075950 0x7f3fd01a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcf7fe640 1 -- 10.20.193.98:0/2175004478 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01a56d0 con 0x7f3fd0106510 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcffff640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3fd0075950 0x7f3fd01a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcf7fe640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0106510 0x7f3fd01a1340 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3fc002f800 tx=0x7f3fc00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcd7fa640 1 -- 10.20.193.98:0/2175004478 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3fc0046070 con 0x7f3fd0106510 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcd7fa640 1 -- 10.20.193.98:0/2175004478 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f3fc0002c20 con 0x7f3fd0106510 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd01a5960 con 0x7f3fd0106510 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fcd7fa640 1 -- 10.20.193.98:0/2175004478 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3fc0041630 con 0x7f3fd0106510 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd01a5e90 con 0x7f3fd0106510 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.466+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd0076b50 con 0x7f3fd0106510 2026-02-20T02:27:09.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.467+0000 7f3fcd7fa640 1 -- 10.20.193.98:0/2175004478 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f3fc0038470 con 0x7f3fd0106510 2026-02-20T02:27:09.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.468+0000 7f3fcd7fa640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f3fa40775a0 0x7f3fa4079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.468+0000 7f3fcd7fa640 1 -- 10.20.193.98:0/2175004478 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f3fc003e070 con 0x7f3fd0106510 2026-02-20T02:27:09.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.468+0000 7f3fcffff640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f3fa40775a0 0x7f3fa4079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.468+0000 7f3fcffff640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f3fa40775a0 0x7f3fa4079a60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00abf0 tx=0x7f3fbc005f50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:09.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.469+0000 7f3fcd7fa640 1 -- 10.20.193.98:0/2175004478 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3fc0050020 con 0x7f3fd0106510 2026-02-20T02:27:09.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.554+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fd01a6140 con 0x7f3fd0106510 2026-02-20T02:27:09.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.554+0000 7f3fcd7fa640 1 -- 10.20.193.98:0/2175004478 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13900 (secure 0 0 0) 0x7f3fc008b730 con 0x7f3fd0106510 2026-02-20T02:27:09.557 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:09.557 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":50,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","created":"2026-02-20T02:24:56.142342+0000","modified":"2026-02-20T02:27:07.842639+0000","last_up_change":"2026-02-20T02:27:06.838718+0000","last_in_change":"2026-02-20T02:26:54.128339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T02:26:21.525878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69983772-bfd2-47c6-858b-c78a6ba6bbdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6802","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6803","nonce":3443765866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6804","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6805","nonce":3443765866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6808","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6809","nonce":3443765866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6806","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6807","nonce":3443765866}]},"public_addr":"10.20.193.98:6803/3443765866","cluster_addr":"10.20.193.98:6805/3443765866","heartbeat_back_addr":"10.20.193.98:6809/3443765866","heartbeat_front_addr":"10.20.193.98:6807/3443765866","state":["exists","up"]},{"osd":1,"uuid":"b4cad49e-fbde-4300-ba11-a955ab405675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6810","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6811","nonce":1242417476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6812","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6813","nonce":1242417476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6816","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6817","nonce":1242417476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6814","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6815","nonce":1242417476}]},"public_addr":"10.20.193.98:6811/1242417476","cluster_addr":"10.20.193.98:6813/1242417476","heartbeat_back_addr":"10.20.193.98:6817/1242417476","heartbeat_front_addr":"10.20.193.98:6815/1242417476","state":["exists","up"]},{"osd":2,"uuid":"7ec05305-8212-4015-b82a-66a1c330bff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6818","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6819","nonce":3521404611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6820","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6821","nonce":3521404611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6824","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6825","nonce":3521404611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6822","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6823","nonce":3521404611}]},"public_addr":"10.20.193.98:6819/3521404611","cluster_addr":"10.20.193.98:6821/3521404611","heartbeat_back_addr":"10.20.193.98:6825/3521404611","heartbeat_front_addr":"10.20.193.98:6823/3521404611","state":["exists","up"]},{"osd":3,"uuid":"62e618a0-0ca1-40e0-8beb-24b9d89ecfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6826","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6827","nonce":3887278641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6828","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6829","nonce":3887278641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6832","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6833","nonce":3887278641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6830","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6831","nonce":3887278641}]},"public_addr":"10.20.193.98:6827/3887278641","cluster_addr":"10.20.193.98:6829/3887278641","heartbeat_back_addr":"10.20.193.98:6833/3887278641","heartbeat_front_addr":"10.20.193.98:6831/3887278641","state":["exists","up"]},{"osd":4,"uuid":"35dfa3a0-e20f-407f-a124-753ef1241351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6800","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6801","nonce":458320702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6803","nonce":458320702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6807","nonce":458320702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6805","nonce":458320702}]},"public_addr":"10.20.193.106:6801/458320702","cluster_addr":"10.20.193.106:6803/458320702","heartbeat_back_addr":"10.20.193.106:6807/458320702","heartbeat_front_addr":"10.20.193.106:6805/458320702","state":["exists","up"]},{"osd":5,"uuid":"646d457d-9777-4425-a4c6-edb74643b7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6809","nonce":1544178256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6810","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6811","nonce":1544178256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6814","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6815","nonce":1544178256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6812","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6813","nonce":1544178256}]},"public_addr":"10.20.193.106:6809/1544178256","cluster_addr":"10.20.193.106:6811/1544178256","heartbeat_back_addr":"10.20.193.106:6815/1544178256","heartbeat_front_addr":"10.20.193.106:6813/1544178256","state":["exists","up"]},{"osd":6,"uuid":"8dbfc155-0624-4bb5-9a00-04227cdb859a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6816","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6817","nonce":3694375899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6818","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6819","nonce":3694375899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6822","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6823","nonce":3694375899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6820","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6821","nonce":3694375899}]},"public_addr":"10.20.193.106:6817/3694375899","cluster_addr":"10.20.193.106:6819/3694375899","heartbeat_back_addr":"10.20.193.106:6823/3694375899","heartbeat_front_addr":"10.20.193.106:6821/3694375899","state":["exists","up"]},{"osd":7,"uuid":"0d9b95d9-47be-4fb9-9796-8f9f75d14e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6824","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6825","nonce":3281087512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6826","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6827","nonce":3281087512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6830","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6831","nonce":3281087512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6828","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6829","nonce":3281087512}]},"public_addr":"10.20.193.106:6825/3281087512","cluster_addr":"10.20.193.106:6827/3281087512","heartbeat_back_addr":"10.20.193.106:6831/3281087512","heartbeat_front_addr":"10.20.193.106:6829/3281087512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:02.738489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:10.724666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:19.868177+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:29.070816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:37.618888+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:47.625118+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:56.407926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:27:05.568619+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.98:0/2186036449":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6801/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/4072581924":"2026-02-21T02:25:05.975323+0000","10.20.193.98:0/757881106":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6800/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/180891152":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/494053877":"2026-02-21T02:25:05.975323+0000","10.20.193.98:0/635628968":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/433631514":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/3304232391":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6800/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:6800/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/3223427167":"2026-02-21T02:25:15.462934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T02:27:09.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f3fa40775a0 msgr2=0x7f3fa4079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f3fa40775a0 0x7f3fa4079a60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00abf0 tx=0x7f3fbc005f50 comp rx=0 tx=0).stop 2026-02-20T02:27:09.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0106510 msgr2=0x7f3fd01a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0106510 0x7f3fd01a1340 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3fc002f800 tx=0x7f3fc00026e0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 shutdown_connections 2026-02-20T02:27:09.559 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f3fa40775a0 0x7f3fa4079a60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.559 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3fd0106510 0x7f3fd01a1340 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.559 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 --2- 10.20.193.98:0/2175004478 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3fd0075950 0x7f3fd01a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.559 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 >> 10.20.193.98:0/2175004478 conn(0x7f3fd00fe360 msgr2=0x7f3fd0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:09.559 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 shutdown_connections 2026-02-20T02:27:09.559 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.555+0000 7f3fd6458640 1 -- 10.20.193.98:0/2175004478 wait complete. 2026-02-20T02:27:09.595 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-20T02:27:09.595 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T02:27:09.749 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:09.860 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 -- 10.20.193.98:0/2106141920 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077f40 msgr2=0x7fa064113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 --2- 10.20.193.98:0/2106141920 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077f40 0x7fa064113280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0580099b0 tx=0x7fa05802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 -- 10.20.193.98:0/2106141920 shutdown_connections 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 --2- 10.20.193.98:0/2106141920 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077f40 0x7fa064113280 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 --2- 10.20.193.98:0/2106141920 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa064077620 0x7fa064077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 -- 10.20.193.98:0/2106141920 >> 10.20.193.98:0/2106141920 conn(0x7fa064100620 msgr2=0x7fa064102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 -- 10.20.193.98:0/2106141920 shutdown_connections 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 -- 10.20.193.98:0/2106141920 wait complete. 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 Processor -- start 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 -- start start 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077620 0x7fa0641a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.861 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa064077f40 0x7fa0641a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa064116070 con 0x7fa064077620 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.856+0000 7fa06be39640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa064115ef0 con 0x7fa064077f40 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa069bae640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077620 0x7fa0641a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa069bae640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077620 0x7fa0641a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44282/0 (socket says 10.20.193.98:44282) 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa069bae640 1 -- 10.20.193.98:0/1682016429 learned_addr learned my addr 10.20.193.98:0/1682016429 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa0693ad640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa064077f40 0x7fa0641a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa069bae640 1 -- 10.20.193.98:0/1682016429 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa064077f40 msgr2=0x7fa0641a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa069bae640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa064077f40 0x7fa0641a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa069bae640 1 -- 10.20.193.98:0/1682016429 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0641a56c0 con 0x7fa064077620 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa069bae640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077620 0x7fa0641a0df0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa05400d8d0 tx=0x7fa05400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:09.862 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa052ffd640 1 -- 10.20.193.98:0/1682016429 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa054014070 con 0x7fa064077620 2026-02-20T02:27:09.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa052ffd640 1 -- 10.20.193.98:0/1682016429 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa0540044a0 con 0x7fa064077620 2026-02-20T02:27:09.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0641a59b0 con 0x7fa064077620 2026-02-20T02:27:09.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa052ffd640 1 -- 10.20.193.98:0/1682016429 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa054002dc0 con 0x7fa064077620 2026-02-20T02:27:09.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0641a5f40 con 0x7fa064077620 2026-02-20T02:27:09.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.857+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa064078d60 con 0x7fa064077620 2026-02-20T02:27:09.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.858+0000 7fa052ffd640 1 -- 10.20.193.98:0/1682016429 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fa05400b840 con 0x7fa064077620 2026-02-20T02:27:09.864 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.859+0000 7fa052ffd640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa0400775a0 0x7fa040079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:09.864 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.859+0000 7fa0693ad640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa0400775a0 0x7fa040079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:09.864 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.859+0000 7fa052ffd640 1 -- 10.20.193.98:0/1682016429 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fa0540999b0 con 0x7fa064077620 2026-02-20T02:27:09.864 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.859+0000 7fa0693ad640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa0400775a0 0x7fa040079a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa064100c70 tx=0x7fa05803a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:09.864 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.860+0000 7fa052ffd640 1 -- 10.20.193.98:0/1682016429 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa054066ac0 con 0x7fa064077620 2026-02-20T02:27:09.947 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.944+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0641a2180 con 0x7fa064077620 2026-02-20T02:27:09.947 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.945+0000 7fa052ffd640 1 -- 10.20.193.98:0/1682016429 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13900 (secure 0 0 0) 0x7fa0641a2180 con 0x7fa064077620 2026-02-20T02:27:09.948 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:09.948 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":50,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","created":"2026-02-20T02:24:56.142342+0000","modified":"2026-02-20T02:27:07.842639+0000","last_up_change":"2026-02-20T02:27:06.838718+0000","last_in_change":"2026-02-20T02:26:54.128339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T02:26:21.525878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69983772-bfd2-47c6-858b-c78a6ba6bbdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6802","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6803","nonce":3443765866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6804","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6805","nonce":3443765866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6808","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6809","nonce":3443765866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6806","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6807","nonce":3443765866}]},"public_addr":"10.20.193.98:6803/3443765866","cluster_addr":"10.20.193.98:6805/3443765866","heartbeat_back_addr":"10.20.193.98:6809/3443765866","heartbeat_front_addr":"10.20.193.98:6807/3443765866","state":["exists","up"]},{"osd":1,"uuid":"b4cad49e-fbde-4300-ba11-a955ab405675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6810","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6811","nonce":1242417476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6812","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6813","nonce":1242417476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6816","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6817","nonce":1242417476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6814","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6815","nonce":1242417476}]},"public_addr":"10.20.193.98:6811/1242417476","cluster_addr":"10.20.193.98:6813/1242417476","heartbeat_back_addr":"10.20.193.98:6817/1242417476","heartbeat_front_addr":"10.20.193.98:6815/1242417476","state":["exists","up"]},{"osd":2,"uuid":"7ec05305-8212-4015-b82a-66a1c330bff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6818","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6819","nonce":3521404611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6820","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6821","nonce":3521404611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6824","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6825","nonce":3521404611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6822","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6823","nonce":3521404611}]},"public_addr":"10.20.193.98:6819/3521404611","cluster_addr":"10.20.193.98:6821/3521404611","heartbeat_back_addr":"10.20.193.98:6825/3521404611","heartbeat_front_addr":"10.20.193.98:6823/3521404611","state":["exists","up"]},{"osd":3,"uuid":"62e618a0-0ca1-40e0-8beb-24b9d89ecfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6826","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6827","nonce":3887278641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6828","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6829","nonce":3887278641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6832","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6833","nonce":3887278641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6830","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6831","nonce":3887278641}]},"public_addr":"10.20.193.98:6827/3887278641","cluster_addr":"10.20.193.98:6829/3887278641","heartbeat_back_addr":"10.20.193.98:6833/3887278641","heartbeat_front_addr":"10.20.193.98:6831/3887278641","state":["exists","up"]},{"osd":4,"uuid":"35dfa3a0-e20f-407f-a124-753ef1241351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6800","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6801","nonce":458320702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6803","nonce":458320702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6807","nonce":458320702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6805","nonce":458320702}]},"public_addr":"10.20.193.106:6801/458320702","cluster_addr":"10.20.193.106:6803/458320702","heartbeat_back_addr":"10.20.193.106:6807/458320702","heartbeat_front_addr":"10.20.193.106:6805/458320702","state":["exists","up"]},{"osd":5,"uuid":"646d457d-9777-4425-a4c6-edb74643b7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6809","nonce":1544178256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6810","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6811","nonce":1544178256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6814","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6815","nonce":1544178256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6812","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6813","nonce":1544178256}]},"public_addr":"10.20.193.106:6809/1544178256","cluster_addr":"10.20.193.106:6811/1544178256","heartbeat_back_addr":"10.20.193.106:6815/1544178256","heartbeat_front_addr":"10.20.193.106:6813/1544178256","state":["exists","up"]},{"osd":6,"uuid":"8dbfc155-0624-4bb5-9a00-04227cdb859a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6816","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6817","nonce":3694375899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6818","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6819","nonce":3694375899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6822","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6823","nonce":3694375899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6820","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6821","nonce":3694375899}]},"public_addr":"10.20.193.106:6817/3694375899","cluster_addr":"10.20.193.106:6819/3694375899","heartbeat_back_addr":"10.20.193.106:6823/3694375899","heartbeat_front_addr":"10.20.193.106:6821/3694375899","state":["exists","up"]},{"osd":7,"uuid":"0d9b95d9-47be-4fb9-9796-8f9f75d14e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6824","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6825","nonce":3281087512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6826","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6827","nonce":3281087512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6830","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6831","nonce":3281087512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6828","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6829","nonce":3281087512}]},"public_addr":"10.20.193.106:6825/3281087512","cluster_addr":"10.20.193.106:6827/3281087512","heartbeat_back_addr":"10.20.193.106:6831/3281087512","heartbeat_front_addr":"10.20.193.106:6829/3281087512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:02.738489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:10.724666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:19.868177+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:29.070816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:37.618888+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:47.625118+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:56.407926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:27:05.568619+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.98:0/2186036449":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6801/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/4072581924":"2026-02-21T02:25:05.975323+0000","10.20.193.98:0/757881106":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6800/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/180891152":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/494053877":"2026-02-21T02:25:05.975323+0000","10.20.193.98:0/635628968":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/433631514":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/3304232391":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6800/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:6800/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/3223427167":"2026-02-21T02:25:15.462934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T02:27:09.949 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa0400775a0 msgr2=0x7fa040079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.949 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa0400775a0 0x7fa040079a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa064100c70 tx=0x7fa05803a040 comp rx=0 tx=0).stop 2026-02-20T02:27:09.949 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077620 msgr2=0x7fa0641a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:09.949 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077620 0x7fa0641a0df0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa05400d8d0 tx=0x7fa05400dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.950 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 shutdown_connections 2026-02-20T02:27:09.950 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa0400775a0 0x7fa040079a60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.950 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa064077f40 0x7fa0641a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.950 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 --2- 10.20.193.98:0/1682016429 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa064077620 0x7fa0641a0df0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:09.950 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 >> 10.20.193.98:0/1682016429 conn(0x7fa064100620 msgr2=0x7fa064101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:09.950 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 shutdown_connections 2026-02-20T02:27:09.950 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:09.946+0000 7fa06be39640 1 -- 10.20.193.98:0/1682016429 wait complete. 2026-02-20T02:27:09.985 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-20T02:27:09.986 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-20T02:27:09.986 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-20T02:27:09.987 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-20T02:27:09.987 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-20T02:27:09.988 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-20T02:27:09.988 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-20T02:27:09.989 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-20T02:27:10.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:09 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4203543654' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-20T02:27:10.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:09 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2175004478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:10.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:09 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4203543654' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-20T02:27:10.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:09 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2175004478' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:10.234 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.234 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.234 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.235 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.235 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.235 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.236 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.238 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.354+0000 7f2547cf6640 1 -- 10.20.193.98:0/2296418869 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540108640 msgr2=0x7f2540108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.354+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2296418869 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540108640 0x7f2540108a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25300099b0 tx=0x7f253002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.354+0000 7f2547cf6640 1 -- 10.20.193.98:0/2296418869 shutdown_connections 2026-02-20T02:27:10.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.354+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2296418869 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2540102640 0x7f2540102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.354+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2296418869 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540108640 0x7f2540108a20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.354+0000 7f2547cf6640 1 -- 10.20.193.98:0/2296418869 >> 10.20.193.98:0/2296418869 conn(0x7f25400fe340 msgr2=0x7f2540100760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.354+0000 7f2547cf6640 1 -- 10.20.193.98:0/2296418869 shutdown_connections 2026-02-20T02:27:10.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.354+0000 7f2547cf6640 1 -- 10.20.193.98:0/2296418869 wait complete. 2026-02-20T02:27:10.359 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2547cf6640 1 Processor -- start 2026-02-20T02:27:10.359 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2547cf6640 1 -- start start 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2547cf6640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540102640 0x7f2540075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2547cf6640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2540108640 0x7f25400758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2547cf6640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f254010f880 con 0x7f2540102640 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2547cf6640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f254010f700 con 0x7f2540108640 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2545a6b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540102640 0x7f2540075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2545a6b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540102640 0x7f2540075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44290/0 (socket says 10.20.193.98:44290) 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.355+0000 7f2545a6b640 1 -- 10.20.193.98:0/2212975410 learned_addr learned my addr 10.20.193.98:0/2212975410 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f254526a640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2540108640 0x7f25400758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f2545a6b640 1 -- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2540108640 msgr2=0x7f25400758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.360 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f2545a6b640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2540108640 0x7f25400758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f2545a6b640 1 -- 10.20.193.98:0/2212975410 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2540075df0 con 0x7f2540102640 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f2545a6b640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540102640 0x7f2540075370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2530009980 tx=0x7f253002fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2530004420 con 0x7f2540102640 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2540076080 con 0x7f2540102640 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25401a6aa0 con 0x7f2540102640 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2530038a40 con 0x7f2540102640 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f25300417e0 con 0x7f2540102640 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.356+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2540063350 con 0x7f2540102640 2026-02-20T02:27:10.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.357+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f2530038bf0 con 0x7f2540102640 2026-02-20T02:27:10.362 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.358+0000 7f252effd640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f251c077550 0x7f251c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.358+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f253003e070 con 0x7f2540102640 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.358+0000 7f252effd640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] conn(0x7f251c07d910 0x7f251c07fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.358+0000 7f254526a640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f251c077550 0x7f251c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.358+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 --> [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f253003ae90 con 0x7f251c07d910 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.358+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f25300beb90 con 0x7f2540102640 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.358+0000 7f254626c640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] conn(0x7f251c07d910 0x7f251c07fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.358+0000 7f254526a640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f251c077550 0x7f251c079a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2540076e00 tx=0x7f2534005f50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.359+0000 7f254626c640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] conn(0x7f251c07d910 0x7f251c07fd30 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.360+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 <== osd.7 v2:10.20.193.106:6824/3281087512 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f253003ae90 con 0x7f251c07d910 2026-02-20T02:27:10.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.363+0000 7f168f588640 1 -- 10.20.193.98:0/3605765282 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 msgr2=0x7f1688104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.363+0000 7f168f588640 1 --2- 10.20.193.98:0/3605765282 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 0x7f1688104cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f167c0099b0 tx=0x7f167c02f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.363+0000 7f168f588640 1 -- 10.20.193.98:0/3605765282 shutdown_connections 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.363+0000 7f168f588640 1 --2- 10.20.193.98:0/3605765282 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 0x7f1688104cf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.363+0000 7f168f588640 1 --2- 10.20.193.98:0/3605765282 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f168810a890 0x7f168810ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.363+0000 7f168f588640 1 -- 10.20.193.98:0/3605765282 >> 10.20.193.98:0/3605765282 conn(0x7f1688100550 msgr2=0x7f1688102970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.363+0000 7f168f588640 1 -- 10.20.193.98:0/3605765282 shutdown_connections 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.363+0000 7f168f588640 1 -- 10.20.193.98:0/3605765282 wait complete. 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168f588640 1 Processor -- start 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168f588640 1 -- start start 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168f588640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 0x7f16881a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168f588640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f168810a890 0x7f16881a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168f588640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1688111ab0 con 0x7f1688104890 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168f588640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1688111930 con 0x7f168810a890 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168d2fd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 0x7f16881a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168d2fd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 0x7f16881a25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44300/0 (socket says 10.20.193.98:44300) 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168d2fd640 1 -- 10.20.193.98:0/2955018220 learned_addr learned my addr 10.20.193.98:0/2955018220 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168cafc640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f168810a890 0x7f16881a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168d2fd640 1 -- 10.20.193.98:0/2955018220 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f168810a890 msgr2=0x7f16881a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168d2fd640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f168810a890 0x7f16881a2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168d2fd640 1 -- 10.20.193.98:0/2955018220 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168819c6c0 con 0x7f1688104890 2026-02-20T02:27:10.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168d2fd640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 0x7f16881a25f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f167800d8d0 tx=0x7f167800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1678014070 con 0x7f1688104890 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168819c9b0 con 0x7f1688104890 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f16780044a0 con 0x7f1688104890 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1678002dc0 con 0x7f1688104890 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.364+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168819cf10 con 0x7f1688104890 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f168819d480 con 0x7f1688104890 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7fbb041e7640 1 -- 10.20.193.98:0/3561194710 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc103840 msgr2=0x7fbafc103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3561194710 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc103840 0x7fbafc103c20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0099e0 tx=0x7fbaec02f2f0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7fbb041e7640 1 -- 10.20.193.98:0/3561194710 shutdown_connections 2026-02-20T02:27:10.368 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3561194710 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fbafc104160 0x7fbafc10c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.368 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3561194710 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc103840 0x7fbafc103c20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.368 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7fbb041e7640 1 -- 10.20.193.98:0/3561194710 >> 10.20.193.98:0/3561194710 conn(0x7fbafc0fd200 msgr2=0x7fbafc0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.368 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7fbb041e7640 1 -- 10.20.193.98:0/3561194710 shutdown_connections 2026-02-20T02:27:10.368 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.365+0000 7fbb041e7640 1 -- 10.20.193.98:0/3561194710 wait complete. 2026-02-20T02:27:10.368 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f167800b840 con 0x7f1688104890 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb041e7640 1 Processor -- start 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb041e7640 1 -- start start 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb041e7640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fbafc103840 0x7fbafc19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb041e7640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc104160 0x7fbafc19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb041e7640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc10f900 con 0x7fbafc104160 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb041e7640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc10f780 con 0x7fbafc103840 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb0175b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc104160 0x7fbafc19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb0175b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc104160 0x7fbafc19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44312/0 (socket says 10.20.193.98:44312) 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb0175b640 1 -- 10.20.193.98:0/3011764575 learned_addr learned my addr 10.20.193.98:0/3011764575 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb01f5c640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fbafc103840 0x7fbafc19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.369 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7f16767fc640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1664077550 0x7f1664079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb0175b640 1 -- 10.20.193.98:0/3011764575 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fbafc103840 msgr2=0x7fbafc19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb0175b640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fbafc103840 0x7fbafc19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb0175b640 1 -- 10.20.193.98:0/3011764575 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc19f010 con 0x7fbafc104160 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7f168cafc640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1664077550 0x7f1664079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f1678099ed0 con 0x7f1688104890 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7f16767fc640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] conn(0x7f166407d910 0x7f166407fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 --> [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16640803e0 con 0x7f166407d910 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f167809a300 con 0x7f1688104890 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbb0175b640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc104160 0x7fbafc19ac80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000b700 tx=0x7fbaf000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.370 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.366+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbaf0004440 con 0x7fbafc104160 2026-02-20T02:27:10.371 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7f168dafe640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] conn(0x7f166407d910 0x7f166407fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.371 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7f168cafc640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1664077550 0x7f1664079a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f168819df10 tx=0x7f167c0023d0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.371 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fbaf0010070 con 0x7fbafc104160 2026-02-20T02:27:10.371 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc19f300 con 0x7fbafc104160 2026-02-20T02:27:10.371 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc19f830 con 0x7fbafc104160 2026-02-20T02:27:10.371 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fbaf000c9b0 con 0x7fbafc104160 2026-02-20T02:27:10.371 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7f168dafe640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] conn(0x7f166407d910 0x7f166407fd30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.372 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbafc19b3c0 con 0x7fbafc104160 2026-02-20T02:27:10.372 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 --> [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25400637a0 con 0x7f251c07d910 2026-02-20T02:27:10.372 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7f252effd640 1 -- 10.20.193.98:0/2212975410 <== osd.7 v2:10.20.193.106:6824/3281087512 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f25400637a0 con 0x7f251c07d910 2026-02-20T02:27:10.372 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 <== osd.0 v2:10.20.193.98:6802/3443765866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f16640803e0 con 0x7f166407d910 2026-02-20T02:27:10.372 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7f938b48a640 1 -- 10.20.193.98:0/3229888701 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384102650 msgr2=0x7f9384102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.372 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.367+0000 7f938b48a640 1 --2- 10.20.193.98:0/3229888701 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384102650 0x7f9384102ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f93780099b0 tx=0x7f937802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.372 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fbaf001d030 con 0x7fbafc104160 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] conn(0x7f251c07d910 msgr2=0x7f251c07fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] conn(0x7f251c07d910 0x7f251c07fd30 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f251c077550 msgr2=0x7f251c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f251c077550 0x7f251c079a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2540076e00 tx=0x7f2534005f50 comp rx=0 tx=0).stop 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540102640 msgr2=0x7f2540075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540102640 0x7f2540075370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2530009980 tx=0x7f253002fdf0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fb6cf197640 1 -- 10.20.193.98:0/2864620805 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075d30 msgr2=0x7fb6c810ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fb6cf197640 1 --2- 10.20.193.98:0/2864620805 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075d30 0x7fb6c810ea40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00099b0 tx=0x7fb6b002f2b0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.373 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f938b48a640 1 -- 10.20.193.98:0/3229888701 shutdown_connections 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f938b48a640 1 --2- 10.20.193.98:0/3229888701 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384102650 0x7f9384102ab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f938b48a640 1 --2- 10.20.193.98:0/3229888701 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9384108650 0x7f9384108a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f938b48a640 1 -- 10.20.193.98:0/3229888701 >> 10.20.193.98:0/3229888701 conn(0x7f93840fe370 msgr2=0x7f9384100790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f938b48a640 1 -- 10.20.193.98:0/3229888701 shutdown_connections 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 shutdown_connections 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:6824/3281087512,v1:10.20.193.106:6825/3281087512] conn(0x7f251c07d910 0x7f251c07fd30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f251c077550 0x7f251c079a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f2540108640 0x7f25400758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 --2- 10.20.193.98:0/2212975410 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f2540102640 0x7f2540075370 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 >> 10.20.193.98:0/2212975410 conn(0x7f25400fe340 msgr2=0x7f25400ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 shutdown_connections 2026-02-20T02:27:10.374 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fbaeaffd640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fbad80775a0 0x7fbad8079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fbb01f5c640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fbad80775a0 0x7fbad8079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fbaf0098610 con 0x7fbafc104160 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f2547cf6640 1 -- 10.20.193.98:0/2212975410 wait complete. 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fbaeaffd640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] conn(0x7fbad807d960 0x7fbad807fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 --> [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbaf001be70 con 0x7fbad807d960 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbaf009f050 con 0x7fbafc104160 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f73939ed640 1 -- 10.20.193.98:0/993356131 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 msgr2=0x7f738c100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f73939ed640 1 --2- 10.20.193.98:0/993356131 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 0x7f738c100b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f73800099b0 tx=0x7f738002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f73939ed640 1 -- 10.20.193.98:0/993356131 shutdown_connections 2026-02-20T02:27:10.375 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f73939ed640 1 --2- 10.20.193.98:0/993356131 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 0x7f738c100b30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.376 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f73939ed640 1 --2- 10.20.193.98:0/993356131 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f738c108820 0x7f738c108c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.376 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f73939ed640 1 -- 10.20.193.98:0/993356131 >> 10.20.193.98:0/993356131 conn(0x7f738c0fc540 msgr2=0x7f738c0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.376 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f73939ed640 1 -- 10.20.193.98:0/993356131 shutdown_connections 2026-02-20T02:27:10.376 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7fbb0275d640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] conn(0x7fbad807d960 0x7fbad807fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.376 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f938b48a640 1 -- 10.20.193.98:0/3229888701 wait complete. 2026-02-20T02:27:10.376 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.368+0000 7f938b48a640 1 Processor -- start 2026-02-20T02:27:10.376 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7fbb01f5c640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fbad80775a0 0x7fbad8079a60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0097c0 tx=0x7fbaec03a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.376 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7fbb0275d640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] conn(0x7fbad807d960 0x7fbad807fd80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f938b48a640 1 -- start start 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f938b48a640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9384102650 0x7f93840700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f938b48a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384108650 0x7f93840705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f938b48a640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f938410f870 con 0x7f9384108650 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f938b48a640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f938410f6f0 con 0x7f9384102650 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f93889fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384108650 0x7f93840705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f93889fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384108650 0x7f93840705f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44342/0 (socket says 10.20.193.98:44342) 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f93889fe640 1 -- 10.20.193.98:0/2805443378 learned_addr learned my addr 10.20.193.98:0/2805443378 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f73939ed640 1 -- 10.20.193.98:0/993356131 wait complete. 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f73939ed640 1 Processor -- start 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f93891ff640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9384102650 0x7f93840700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.377 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f93889fe640 1 -- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9384102650 msgr2=0x7f93840700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f93889fe640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9384102650 0x7f93840700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f93889fe640 1 -- 10.20.193.98:0/2805443378 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9384077190 con 0x7f9384108650 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f73939ed640 1 -- start start 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f73939ed640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 0x7f738c19d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f73939ed640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f738c108820 0x7f738c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f73939ed640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f738c10f840 con 0x7f738c1006b0 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f73939ed640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f738c10f6c0 con 0x7f738c108820 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f93889fe640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384108650 0x7f93840705f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9378002410 tx=0x7f93780028b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f7391762640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 0x7f738c19d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f7391762640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 0x7f738c19d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44344/0 (socket says 10.20.193.98:44344) 2026-02-20T02:27:10.378 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f7391762640 1 -- 10.20.193.98:0/4096230561 learned_addr learned my addr 10.20.193.98:0/4096230561 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 <== osd.3 v2:10.20.193.98:6826/3887278641 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fbaf001be70 con 0x7fbad807d960 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f7390f61640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f738c108820 0x7f738c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f7391762640 1 -- 10.20.193.98:0/4096230561 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f738c108820 msgr2=0x7f738c19d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f7391762640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f738c108820 0x7f738c19d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.369+0000 7f7391762640 1 -- 10.20.193.98:0/4096230561 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c1a2d60 con 0x7f738c1006b0 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f7391762640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 0x7f738c19d040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f737c00ca30 tx=0x7f737c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9378004420 con 0x7f9384108650 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9378038a40 con 0x7f9384108650 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9378041880 con 0x7f9384108650 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9384070b30 con 0x7f9384108650 2026-02-20T02:27:10.379 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9384074b50 con 0x7f9384108650 2026-02-20T02:27:10.380 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f737c013070 con 0x7f738c1006b0 2026-02-20T02:27:10.380 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f737c007da0 con 0x7f738c1006b0 2026-02-20T02:27:10.380 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c1a3050 con 0x7f738c1006b0 2026-02-20T02:27:10.380 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f737c002e20 con 0x7f738c1006b0 2026-02-20T02:27:10.380 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c1a35e0 con 0x7f738c1006b0 2026-02-20T02:27:10.380 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93840750a0 con 0x7f9384108650 2026-02-20T02:27:10.380 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.370+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f738c101ad0 con 0x7f738c1006b0 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 -- 10.20.193.98:0/2864620805 shutdown_connections 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 --2- 10.20.193.98:0/2864620805 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075d30 0x7fb6c810ea40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 --2- 10.20.193.98:0/2864620805 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6c8075410 0x7fb6c80757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 -- 10.20.193.98:0/2864620805 >> 10.20.193.98:0/2864620805 conn(0x7fb6c80fe340 msgr2=0x7fb6c8100760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 -- 10.20.193.98:0/2864620805 shutdown_connections 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 -- 10.20.193.98:0/2864620805 wait complete. 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f9378038bf0 con 0x7f9384108650 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 Processor -- start 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 -- start start 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075410 0x7fb6c81a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.381 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6c8075d30 0x7fb6c81a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8111b70 con 0x7fb6c8075410 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6cf197640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81119f0 con 0x7fb6c8075d30 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6ccf0c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075410 0x7fb6c81a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6ccf0c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075410 0x7fb6c81a2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44370/0 (socket says 10.20.193.98:44370) 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7fb6ccf0c640 1 -- 10.20.193.98:0/3549435488 learned_addr learned my addr 10.20.193.98:0/3549435488 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.371+0000 7f93727fc640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f93600775f0 0x7f9360079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6bffff640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6c8075d30 0x7fb6c81a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6ccf0c640 1 -- 10.20.193.98:0/3549435488 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6c8075d30 msgr2=0x7fb6c81a2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6ccf0c640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6c8075d30 0x7fb6c81a2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.382 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6ccf0c640 1 -- 10.20.193.98:0/3549435488 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c819c7d0 con 0x7fb6c8075410 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f937803e070 con 0x7f9384108650 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f93891ff640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f93600775f0 0x7f9360079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f93727fc640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] conn(0x7f936007d9b0 0x7f936007fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 --> [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f937800b0b0 con 0x7f936007d9b0 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f93780bebf0 con 0x7f9384108650 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6ccf0c640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075410 0x7fb6c81a2650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800b700 tx=0x7fb6b800bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f93891ff640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f93600775f0 0x7f9360079ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9374005f10 tx=0x7f9374005ea0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f737c007930 con 0x7f738c1006b0 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb6b8004440 con 0x7fb6c8075410 2026-02-20T02:27:10.383 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb6b8010070 con 0x7fb6c8075410 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c819cac0 con 0x7fb6c8075410 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb6b800c9b0 con 0x7fb6c8075410 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c819d050 con 0x7fb6c8075410 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3976841694 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a14104920 msgr2=0x7f1a14104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3976841694 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a14104920 0x7f1a14104d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1a040099b0 tx=0x7f1a0402f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3976841694 shutdown_connections 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3976841694 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a14104920 0x7f1a14104d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3976841694 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1a1410a920 0x7f1a1410ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3976841694 >> 10.20.193.98:0/3976841694 conn(0x7f1a14100620 msgr2=0x7f1a14102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f737a7fc640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f7368077550 0x7f7368079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.384 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.372+0000 7f7390f61640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f7368077550 0x7f7368079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f737c099d40 con 0x7f738c1006b0 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6c819d5f0 con 0x7fb6c8075410 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f737a7fc640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] conn(0x7f736807d910 0x7f736807fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 --> [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73680803e0 con 0x7f736807d910 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f737c09a140 con 0x7f738c1006b0 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f7391f63640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] conn(0x7f736807d910 0x7f736807fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f7390f61640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f7368077550 0x7f7368079a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f738c199920 tx=0x7f738003a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f7391f63640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] conn(0x7f736807d910 0x7f736807fd30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.385 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3976841694 shutdown_connections 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3976841694 wait complete. 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f1a1a33d640 1 Processor -- start 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f1a1a33d640 1 -- start start 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.373+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 <== osd.1 v2:10.20.193.98:6810/1242417476 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f73680803e0 con 0x7f736807d910 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a1a33d640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1a14104920 0x7f1a1419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a1a33d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a1410a920 0x7f1a1419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f9389a00640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] conn(0x7f936007d9b0 0x7f936007fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a137fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a1410a920 0x7f1a1419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.386 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a137fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a1410a920 0x7f1a1419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44384/0 (socket says 10.20.193.98:44384) 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a137fe640 1 -- 10.20.193.98:0/3153943007 learned_addr learned my addr 10.20.193.98:0/3153943007 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14111bc0 con 0x7f1a1410a920 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14111a40 con 0x7f1a14104920 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fb6b801d030 con 0x7fb6c8075410 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a13fff640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1a14104920 0x7f1a1419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a137fe640 1 -- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1a14104920 msgr2=0x7f1a1419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a137fe640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1a14104920 0x7f1a1419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a137fe640 1 -- 10.20.193.98:0/3153943007 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a141a1010 con 0x7f1a1410a920 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a13fff640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1a14104920 0x7f1a1419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:10.387 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a137fe640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a1410a920 0x7f1a1419cc80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009380 tx=0x7f1a04004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1a04046070 con 0x7f1a1410a920 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a141a12a0 con 0x7f1a1410a920 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1a04038a40 con 0x7f1a1410a920 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1a04041a20 con 0x7f1a1410a920 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f9389a00640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] conn(0x7f936007d9b0 0x7f936007fdd0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a141a1710 con 0x7f1a1410a920 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7fb6bdffb640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6a40775a0 0x7fb6a4079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7fb6bffff640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6a40775a0 0x7fb6a4079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.388 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fb6b8098570 con 0x7fb6c8075410 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7fb6bdffb640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] conn(0x7fb6a407d960 0x7fb6a407fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 --> [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6b801be70 con 0x7fb6a407d960 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.374+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb6b809f050 con 0x7fb6c8075410 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.375+0000 7fb6cd70d640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] conn(0x7fb6a407d960 0x7fb6a407fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.375+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a141a1d30 con 0x7f1a1410a920 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.375+0000 7fb6cd70d640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] conn(0x7fb6a407d960 0x7fb6a407fd80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.375+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 <== osd.4 v2:10.20.193.106:6800/458320702 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f937800b0b0 con 0x7f936007d9b0 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.375+0000 7fb6bffff640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6a40775a0 0x7fb6a4079a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb6c810bcc0 tx=0x7fb6b003a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.389 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.375+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 --> [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1688063390 con 0x7f166407d910 2026-02-20T02:27:10.390 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.375+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f1a04038bf0 con 0x7f1a1410a920 2026-02-20T02:27:10.390 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.375+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 <== osd.2 v2:10.20.193.98:6818/3521404611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fb6b801be70 con 0x7fb6a407d960 2026-02-20T02:27:10.390 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f16767fc640 1 -- 10.20.193.98:0/2955018220 <== osd.0 v2:10.20.193.98:6802/3443765866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1688063390 con 0x7f166407d910 2026-02-20T02:27:10.390 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f1a117fa640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19e80775a0 0x7f19e8079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.390 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f1a13fff640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19e80775a0 0x7f19e8079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.390 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f1a0403e070 con 0x7f1a1410a920 2026-02-20T02:27:10.391 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f1a117fa640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] conn(0x7f19e807d960 0x7f19e807fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.391 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 --> [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a04007e80 con 0x7f19e807d960 2026-02-20T02:27:10.391 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1a040be700 con 0x7f1a1410a920 2026-02-20T02:27:10.391 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f1a13fff640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19e80775a0 0x7f19e8079a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a00006fd0 tx=0x7f1a00008040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.391 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.376+0000 7f1a188b3640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] conn(0x7f19e807d960 0x7f19e807fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.391 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.377+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 --> [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbafc063340 con 0x7fbad807d960 2026-02-20T02:27:10.391 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.377+0000 7f1a188b3640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] conn(0x7f19e807d960 0x7f19e807fd80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.391 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.377+0000 7fbaeaffd640 1 -- 10.20.193.98:0/3011764575 <== osd.3 v2:10.20.193.98:6826/3887278641 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbafc063340 con 0x7fbad807d960 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.377+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] conn(0x7fbad807d960 msgr2=0x7fbad807fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.377+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] conn(0x7fbad807d960 0x7fbad807fd80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.377+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fbad80775a0 msgr2=0x7fbad8079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.377+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fbad80775a0 0x7fbad8079a60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0097c0 tx=0x7fbaec03a040 comp rx=0 tx=0).stop 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc104160 msgr2=0x7fbafc19ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc104160 0x7fbafc19ac80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000b700 tx=0x7fbaf000bbd0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 shutdown_connections 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6826/3887278641,v1:10.20.193.98:6827/3887278641] conn(0x7fbad807d960 0x7fbad807fd80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.392 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fbad80775a0 0x7fbad8079a60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fbafc104160 0x7fbafc19ac80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 --2- 10.20.193.98:0/3011764575 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fbafc103840 0x7fbafc19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 >> 10.20.193.98:0/3011764575 conn(0x7fbafc0fd200 msgr2=0x7fbafc104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 shutdown_connections 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] conn(0x7f166407d910 msgr2=0x7f166407fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7f168f588640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] conn(0x7f166407d910 0x7f166407fd30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1664077550 msgr2=0x7f1664079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7f168f588640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1664077550 0x7f1664079a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f168819df10 tx=0x7f167c0023d0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 msgr2=0x7f16881a25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7f168f588640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 0x7f16881a25f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f167800d8d0 tx=0x7f167800dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7fbb041e7640 1 -- 10.20.193.98:0/3011764575 wait complete. 2026-02-20T02:27:10.393 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.378+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 <== osd.5 v2:10.20.193.106:6808/1544178256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f1a04007e80 con 0x7f19e807d960 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.379+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 shutdown_connections 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.379+0000 7f168f588640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6802/3443765866,v1:10.20.193.98:6803/3443765866] conn(0x7f166407d910 0x7f166407fd30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.379+0000 7f168f588640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1664077550 0x7f1664079a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.379+0000 7f168f588640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f168810a890 0x7f16881a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.379+0000 7f168f588640 1 --2- 10.20.193.98:0/2955018220 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1688104890 0x7f16881a25f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.379+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 >> 10.20.193.98:0/2955018220 conn(0x7f1688100550 msgr2=0x7f1688101730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.380+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 shutdown_connections 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.380+0000 7f168f588640 1 -- 10.20.193.98:0/2955018220 wait complete. 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 --> [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f738c1983b0 con 0x7f736807d910 2026-02-20T02:27:10.394 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f737a7fc640 1 -- 10.20.193.98:0/4096230561 <== osd.1 v2:10.20.193.98:6810/1242417476 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f738c1983b0 con 0x7f736807d910 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] conn(0x7f736807d910 msgr2=0x7f736807fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] conn(0x7f736807d910 0x7f736807fd30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f7368077550 msgr2=0x7f7368079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f7368077550 0x7f7368079a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f738c199920 tx=0x7f738003a040 comp rx=0 tx=0).stop 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 msgr2=0x7f738c19d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 0x7f738c19d040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f737c00ca30 tx=0x7f737c00cf00 comp rx=0 tx=0).stop 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 shutdown_connections 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6810/1242417476,v1:10.20.193.98:6811/1242417476] conn(0x7f736807d910 0x7f736807fd30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f7368077550 0x7f7368079a10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f738c108820 0x7f738c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 --2- 10.20.193.98:0/4096230561 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f738c1006b0 0x7f738c19d040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 >> 10.20.193.98:0/4096230561 conn(0x7f738c0fc540 msgr2=0x7f738c102990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.395 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 shutdown_connections 2026-02-20T02:27:10.396 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.381+0000 7f73939ed640 1 -- 10.20.193.98:0/4096230561 wait complete. 2026-02-20T02:27:10.396 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.382+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 --> [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f93840754f0 con 0x7f936007d9b0 2026-02-20T02:27:10.396 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f93727fc640 1 -- 10.20.193.98:0/2805443378 <== osd.4 v2:10.20.193.106:6800/458320702 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f93840754f0 con 0x7f936007d9b0 2026-02-20T02:27:10.396 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 --> [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6c8063340 con 0x7fb6a407d960 2026-02-20T02:27:10.396 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6bdffb640 1 -- 10.20.193.98:0/3549435488 <== osd.2 v2:10.20.193.98:6818/3521404611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb6c8063340 con 0x7fb6a407d960 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] conn(0x7f936007d9b0 msgr2=0x7f936007fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] conn(0x7f936007d9b0 0x7f936007fdd0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f93600775f0 msgr2=0x7f9360079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f93600775f0 0x7f9360079ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9374005f10 tx=0x7f9374005ea0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384108650 msgr2=0x7f93840705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384108650 0x7f93840705f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9378002410 tx=0x7f93780028b0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 shutdown_connections 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:6800/458320702,v1:10.20.193.106:6801/458320702] conn(0x7f936007d9b0 0x7f936007fdd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f93600775f0 0x7f9360079ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9384108650 0x7f93840705f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 --2- 10.20.193.98:0/2805443378 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9384102650 0x7f93840700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 >> 10.20.193.98:0/2805443378 conn(0x7f93840fe370 msgr2=0x7f93840ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 shutdown_connections 2026-02-20T02:27:10.397 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7f938b48a640 1 -- 10.20.193.98:0/2805443378 wait complete. 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] conn(0x7fb6a407d960 msgr2=0x7fb6a407fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] conn(0x7fb6a407d960 0x7fb6a407fd80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6a40775a0 msgr2=0x7fb6a4079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6a40775a0 0x7fb6a4079a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb6c810bcc0 tx=0x7fb6b003a040 comp rx=0 tx=0).stop 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075410 msgr2=0x7fb6c81a2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075410 0x7fb6c81a2650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800b700 tx=0x7fb6b800bbd0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 shutdown_connections 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6818/3521404611,v1:10.20.193.98:6819/3521404611] conn(0x7fb6a407d960 0x7fb6a407fd80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6a40775a0 0x7fb6a4079a60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6c8075d30 0x7fb6c81a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 --2- 10.20.193.98:0/3549435488 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6c8075410 0x7fb6c81a2650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 >> 10.20.193.98:0/3549435488 conn(0x7fb6c80fe340 msgr2=0x7fb6c8106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 shutdown_connections 2026-02-20T02:27:10.398 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.383+0000 7fb6cf197640 1 -- 10.20.193.98:0/3549435488 wait complete. 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 --> [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a14063340 con 0x7f19e807d960 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a117fa640 1 -- 10.20.193.98:0/3153943007 <== osd.5 v2:10.20.193.106:6808/1544178256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1a14063340 con 0x7f19e807d960 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] conn(0x7f19e807d960 msgr2=0x7f19e807fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] conn(0x7f19e807d960 0x7f19e807fd80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19e80775a0 msgr2=0x7f19e8079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19e80775a0 0x7f19e8079a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a00006fd0 tx=0x7f1a00008040 comp rx=0 tx=0).stop 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a1410a920 msgr2=0x7f1a1419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a1410a920 0x7f1a1419cc80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009380 tx=0x7f1a04004350 comp rx=0 tx=0).stop 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 shutdown_connections 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:6808/1544178256,v1:10.20.193.106:6809/1544178256] conn(0x7f19e807d960 0x7f19e807fd80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19e80775a0 0x7f19e8079a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1a1410a920 0x7f1a1419cc80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.399 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 --2- 10.20.193.98:0/3153943007 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1a14104920 0x7f1a1419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.400 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 >> 10.20.193.98:0/3153943007 conn(0x7f1a14100620 msgr2=0x7f1a14100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.400 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 shutdown_connections 2026-02-20T02:27:10.400 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.385+0000 7f1a1a33d640 1 -- 10.20.193.98:0/3153943007 wait complete. 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 -- 10.20.193.98:0/149742504 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8102640 msgr2=0x7f87b8102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 --2- 10.20.193.98:0/149742504 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8102640 0x7f87b8102aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0099b0 tx=0x7f87ac02f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 -- 10.20.193.98:0/149742504 shutdown_connections 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 --2- 10.20.193.98:0/149742504 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8102640 0x7f87b8102aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 --2- 10.20.193.98:0/149742504 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f87b8108640 0x7f87b8108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 -- 10.20.193.98:0/149742504 >> 10.20.193.98:0/149742504 conn(0x7f87b80fe360 msgr2=0x7f87b8100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 -- 10.20.193.98:0/149742504 shutdown_connections 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 -- 10.20.193.98:0/149742504 wait complete. 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 Processor -- start 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.389+0000 7f87bf870640 1 -- start start 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bf870640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f87b8102640 0x7f87b8075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bf870640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8108640 0x7f87b80758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bf870640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87b810f860 con 0x7f87b8108640 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bf870640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f87b810f6e0 con 0x7f87b8102640 2026-02-20T02:27:10.401 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bd5e5640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f87b8102640 0x7f87b8075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bd5e5640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f87b8102640 0x7f87b8075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.106:3300/0 says I am v2:10.20.193.98:60722/0 (socket says 10.20.193.98:60722) 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bd5e5640 1 -- 10.20.193.98:0/2631968266 learned_addr learned my addr 10.20.193.98:0/2631968266 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bcde4640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8108640 0x7f87b80758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bcde4640 1 -- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f87b8102640 msgr2=0x7f87b8075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bcde4640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f87b8102640 0x7f87b8075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bcde4640 1 -- 10.20.193.98:0/2631968266 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b8075df0 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bd5e5640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f87b8102640 0x7f87b8075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bcde4640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8108640 0x7f87b80758b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87ac02f730 tx=0x7f87ac02fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f87ac02fe60 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b8076080 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f87ac004420 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f87ac0415c0 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.390+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b81a6ae0 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.391+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f87b8063350 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.392+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f87ac041870 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.392+0000 7f87a67fc640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8794077550 0x7f8794079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.392+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f87ac03e070 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.392+0000 7f87bd5e5640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8794077550 0x7f8794079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.392+0000 7f87a67fc640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] conn(0x7f879407d910 0x7f879407fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.392+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 --> [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87ac009030 con 0x7f879407d910 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.392+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f87ac0be7e0 con 0x7f87b8108640 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.392+0000 7f87bd5e5640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8794077550 0x7f8794079a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009fd0 tx=0x7f87a8009290 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.393+0000 7f87bdde6640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] conn(0x7f879407d910 0x7f879407fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.393+0000 7f87bdde6640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] conn(0x7f879407d910 0x7f879407fd30 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.402 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.394+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 <== osd.6 v2:10.20.193.106:6816/3694375899 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f87ac009030 con 0x7f879407d910 2026-02-20T02:27:10.404 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.402+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 --> [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f87b80637a0 con 0x7f879407d910 2026-02-20T02:27:10.404 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.402+0000 7f87a67fc640 1 -- 10.20.193.98:0/2631968266 <== osd.6 v2:10.20.193.106:6816/3694375899 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f87b80637a0 con 0x7f879407d910 2026-02-20T02:27:10.405 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.403+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] conn(0x7f879407d910 msgr2=0x7f879407fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.405 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.403+0000 7f87bf870640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] conn(0x7f879407d910 0x7f879407fd30 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.405 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.403+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8794077550 msgr2=0x7f8794079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.405 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.403+0000 7f87bf870640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8794077550 0x7f8794079a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009fd0 tx=0x7f87a8009290 comp rx=0 tx=0).stop 2026-02-20T02:27:10.405 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.403+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8108640 msgr2=0x7f87b80758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.405 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.403+0000 7f87bf870640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8108640 0x7f87b80758b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87ac02f730 tx=0x7f87ac02fcb0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.404+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 shutdown_connections 2026-02-20T02:27:10.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.404+0000 7f87bf870640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:6816/3694375899,v1:10.20.193.106:6817/3694375899] conn(0x7f879407d910 0x7f879407fd30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.404+0000 7f87bf870640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8794077550 0x7f8794079a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.404+0000 7f87bf870640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f87b8108640 0x7f87b80758b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.404+0000 7f87bf870640 1 --2- 10.20.193.98:0/2631968266 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f87b8102640 0x7f87b8075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.404+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 >> 10.20.193.98:0/2631968266 conn(0x7f87b80fe360 msgr2=0x7f87b80ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.404+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 shutdown_connections 2026-02-20T02:27:10.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.404+0000 7f87bf870640 1 -- 10.20.193.98:0/2631968266 wait complete. 2026-02-20T02:27:10.415 INFO:teuthology.orchestra.run.trial098.stdout:210453397507 2026-02-20T02:27:10.416 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-20T02:27:10.437 INFO:teuthology.orchestra.run.trial098.stdout:64424509455 2026-02-20T02:27:10.437 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-20T02:27:10.442 INFO:teuthology.orchestra.run.trial098.stdout:85899345932 2026-02-20T02:27:10.442 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-20T02:27:10.449 INFO:teuthology.orchestra.run.trial098.stdout:115964117003 2026-02-20T02:27:10.449 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-20T02:27:10.451 INFO:teuthology.orchestra.run.trial098.stdout:163208757253 2026-02-20T02:27:10.451 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-20T02:27:10.458 INFO:teuthology.orchestra.run.trial098.stdout:188978561028 2026-02-20T02:27:10.459 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-20T02:27:10.486 INFO:teuthology.orchestra.run.trial098.stdout:42949672977 2026-02-20T02:27:10.487 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-20T02:27:10.489 INFO:teuthology.orchestra.run.trial098.stdout:137438953481 2026-02-20T02:27:10.489 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-20T02:27:10.613 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.614 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.614 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.707 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.710 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.731 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 -- 10.20.193.98:0/1552722388 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 msgr2=0x7fd34410ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 --2- 10.20.193.98:0/1552722388 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 0x7fd34410ad00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd3340099b0 tx=0x7fd33402f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 -- 10.20.193.98:0/1552722388 shutdown_connections 2026-02-20T02:27:10.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 --2- 10.20.193.98:0/1552722388 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd344104920 0x7fd344104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 --2- 10.20.193.98:0/1552722388 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 0x7fd34410ad00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 -- 10.20.193.98:0/1552722388 >> 10.20.193.98:0/1552722388 conn(0x7fd344100620 msgr2=0x7fd344102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 -- 10.20.193.98:0/1552722388 shutdown_connections 2026-02-20T02:27:10.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 -- 10.20.193.98:0/1552722388 wait complete. 2026-02-20T02:27:10.732 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 Processor -- start 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 -- start start 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd344104920 0x7fd3441a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 0x7fd3441a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd344111b40 con 0x7fd34410a920 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd34c1b0640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd3441119c0 con 0x7fd344104920 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd349724640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 0x7fd3441a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd349724640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 0x7fd3441a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44424/0 (socket says 10.20.193.98:44424) 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd349724640 1 -- 10.20.193.98:0/4241160246 learned_addr learned my addr 10.20.193.98:0/4241160246 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.728+0000 7fd349f25640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd344104920 0x7fd3441a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd349724640 1 -- 10.20.193.98:0/4241160246 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd344104920 msgr2=0x7fd3441a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd349724640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd344104920 0x7fd3441a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.733 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd349724640 1 -- 10.20.193.98:0/4241160246 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34419c7a0 con 0x7fd34410a920 2026-02-20T02:27:10.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd349724640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 0x7fd3441a2b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd33800ca30 tx=0x7fd33800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd332ffd640 1 -- 10.20.193.98:0/4241160246 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd338013070 con 0x7fd34410a920 2026-02-20T02:27:10.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd332ffd640 1 -- 10.20.193.98:0/4241160246 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fd338007da0 con 0x7fd34410a920 2026-02-20T02:27:10.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34419ca90 con 0x7fd34410a920 2026-02-20T02:27:10.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd332ffd640 1 -- 10.20.193.98:0/4241160246 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd338002e20 con 0x7fd34410a920 2026-02-20T02:27:10.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34419d020 con 0x7fd34410a920 2026-02-20T02:27:10.734 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fb744051640 1 -- 10.20.193.98:0/2691897803 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 msgr2=0x7fb73c10ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.735 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fb744051640 1 --2- 10.20.193.98:0/2691897803 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 0x7fb73c10ad00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0099b0 tx=0x7fb72c02f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.735 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.729+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd344106060 con 0x7fd34410a920 2026-02-20T02:27:10.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.730+0000 7fb744051640 1 -- 10.20.193.98:0/2691897803 shutdown_connections 2026-02-20T02:27:10.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.730+0000 7fb744051640 1 --2- 10.20.193.98:0/2691897803 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb73c104920 0x7fb73c104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.730+0000 7fb744051640 1 --2- 10.20.193.98:0/2691897803 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 0x7fb73c10ad00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.730+0000 7fb744051640 1 -- 10.20.193.98:0/2691897803 >> 10.20.193.98:0/2691897803 conn(0x7fb73c100620 msgr2=0x7fb73c102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.730+0000 7fb744051640 1 -- 10.20.193.98:0/2691897803 shutdown_connections 2026-02-20T02:27:10.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.730+0000 7fb744051640 1 -- 10.20.193.98:0/2691897803 wait complete. 2026-02-20T02:27:10.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.730+0000 7fb744051640 1 Processor -- start 2026-02-20T02:27:10.736 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb744051640 1 -- start start 2026-02-20T02:27:10.737 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fd332ffd640 1 -- 10.20.193.98:0/4241160246 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fd338007930 con 0x7fd34410a920 2026-02-20T02:27:10.738 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb744051640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb73c104920 0x7fb73c1a2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.738 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb744051640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 0x7fb73c1a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.738 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb744051640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c111b60 con 0x7fb73c10a920 2026-02-20T02:27:10.738 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb744051640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c1119e0 con 0x7fb73c104920 2026-02-20T02:27:10.738 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb7415c5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 0x7fb73c1a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.738 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb7415c5640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 0x7fb73c1a2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44428/0 (socket says 10.20.193.98:44428) 2026-02-20T02:27:10.738 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb7415c5640 1 -- 10.20.193.98:0/420614451 learned_addr learned my addr 10.20.193.98:0/420614451 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.738 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb741dc6640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb73c104920 0x7fb73c1a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.739 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fd332ffd640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd320077550 0x7fd320079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.739 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fd332ffd640 1 -- 10.20.193.98:0/4241160246 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fd338099d50 con 0x7fd34410a920 2026-02-20T02:27:10.739 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fd349f25640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd320077550 0x7fd320079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.739 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb7415c5640 1 -- 10.20.193.98:0/420614451 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb73c104920 msgr2=0x7fb73c1a2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.740 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb7415c5640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb73c104920 0x7fb73c1a2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.740 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb7415c5640 1 -- 10.20.193.98:0/420614451 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c19c730 con 0x7fb73c10a920 2026-02-20T02:27:10.740 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fb7415c5640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 0x7fb73c1a2ba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb73000d900 tx=0x7fb73000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.740 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.731+0000 7fd349f25640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd320077550 0x7fd320079a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3340097c0 tx=0x7fd33403a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.741 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.733+0000 7fb72affd640 1 -- 10.20.193.98:0/420614451 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb730014070 con 0x7fb73c10a920 2026-02-20T02:27:10.741 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.733+0000 7fb72affd640 1 -- 10.20.193.98:0/420614451 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb7300044a0 con 0x7fb73c10a920 2026-02-20T02:27:10.741 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.733+0000 7fb72affd640 1 -- 10.20.193.98:0/420614451 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb73000be00 con 0x7fb73c10a920 2026-02-20T02:27:10.741 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.733+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73c19ca20 con 0x7fb73c10a920 2026-02-20T02:27:10.741 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.733+0000 7fd332ffd640 1 -- 10.20.193.98:0/4241160246 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd338004440 con 0x7fd34410a920 2026-02-20T02:27:10.742 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.733+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73c19cf80 con 0x7fb73c10a920 2026-02-20T02:27:10.742 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.733+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73c106060 con 0x7fb73c10a920 2026-02-20T02:27:10.742 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.734+0000 7fb72affd640 1 -- 10.20.193.98:0/420614451 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fb7300047c0 con 0x7fb73c10a920 2026-02-20T02:27:10.742 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.734+0000 7fb72affd640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb7180775a0 0x7fb718079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.743 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.734+0000 7fb72affd640 1 -- 10.20.193.98:0/420614451 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fb730099650 con 0x7fb73c10a920 2026-02-20T02:27:10.743 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.735+0000 7fb741dc6640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb7180775a0 0x7fb718079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.743 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.735+0000 7fb741dc6640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb7180775a0 0x7fb718079a60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb72c005ec0 tx=0x7fb72c005e50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.743 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.737+0000 7fb72affd640 1 -- 10.20.193.98:0/420614451 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb7300666e0 con 0x7fb73c10a920 2026-02-20T02:27:10.743 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.746 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.750 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:10.752 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.748+0000 7fead54c2640 1 -- 10.20.193.98:0/2403699929 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead010a920 msgr2=0x7fead010ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.752 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.748+0000 7fead54c2640 1 --2- 10.20.193.98:0/2403699929 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead010a920 0x7fead010ad00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feac40099b0 tx=0x7feac402f240 comp rx=0 tx=0).stop 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.748+0000 7fead54c2640 1 -- 10.20.193.98:0/2403699929 shutdown_connections 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.748+0000 7fead54c2640 1 --2- 10.20.193.98:0/2403699929 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fead0104920 0x7fead0104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.748+0000 7fead54c2640 1 --2- 10.20.193.98:0/2403699929 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead010a920 0x7fead010ad00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.748+0000 7fead54c2640 1 -- 10.20.193.98:0/2403699929 >> 10.20.193.98:0/2403699929 conn(0x7fead0100620 msgr2=0x7fead0102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.748+0000 7fead54c2640 1 -- 10.20.193.98:0/2403699929 shutdown_connections 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.748+0000 7fead54c2640 1 -- 10.20.193.98:0/2403699929 wait complete. 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7fead54c2640 1 Processor -- start 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7fead54c2640 1 -- start start 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7fead54c2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead0104920 0x7fead01a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7fead54c2640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fead010a920 0x7fead01a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7fead54c2640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fead0111be0 con 0x7fead0104920 2026-02-20T02:27:10.753 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7fead54c2640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fead0111a60 con 0x7fead010a920 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaceffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead0104920 0x7fead01a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaceffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead0104920 0x7fead01a2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44438/0 (socket says 10.20.193.98:44438) 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaceffd640 1 -- 10.20.193.98:0/4248031168 learned_addr learned my addr 10.20.193.98:0/4248031168 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaceffd640 1 -- 10.20.193.98:0/4248031168 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fead010a920 msgr2=0x7fead01a2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feace7fc640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fead010a920 0x7fead01a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaceffd640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fead010a920 0x7fead01a2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaceffd640 1 -- 10.20.193.98:0/4248031168 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead019c7b0 con 0x7fead0104920 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feace7fc640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fead010a920 0x7fead01a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaceffd640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead0104920 0x7fead01a2630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feac4002410 tx=0x7feac402fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaaffff640 1 -- 10.20.193.98:0/4248031168 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7feac40044e0 con 0x7fead0104920 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead019ca40 con 0x7fead0104920 2026-02-20T02:27:10.754 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaaffff640 1 -- 10.20.193.98:0/4248031168 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7feac4038be0 con 0x7fead0104920 2026-02-20T02:27:10.755 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7feaaffff640 1 -- 10.20.193.98:0/4248031168 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7feac4041a60 con 0x7fead0104920 2026-02-20T02:27:10.755 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.749+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead019cf70 con 0x7fead0104920 2026-02-20T02:27:10.755 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.750+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead0106060 con 0x7fead0104920 2026-02-20T02:27:10.756 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.751+0000 7feaaffff640 1 -- 10.20.193.98:0/4248031168 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7feac4041c00 con 0x7fead0104920 2026-02-20T02:27:10.756 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.751+0000 7feaaffff640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feaa40775a0 0x7feaa4079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.756 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.751+0000 7feace7fc640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feaa40775a0 0x7feaa4079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.756 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.751+0000 7feaaffff640 1 -- 10.20.193.98:0/4248031168 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7feac403e070 con 0x7fead0104920 2026-02-20T02:27:10.756 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.751+0000 7feace7fc640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feaa40775a0 0x7feaa4079a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fead010a130 tx=0x7feab8008040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.756 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.754+0000 7feaaffff640 1 -- 10.20.193.98:0/4248031168 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7feac4049340 con 0x7fead0104920 2026-02-20T02:27:10.827 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 -- 10.20.193.98:0/3024718380 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 msgr2=0x7f53c4075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.828 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 --2- 10.20.193.98:0/3024718380 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 0x7f53c4075d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0099e0 tx=0x7f53ac02f2f0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.828 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 -- 10.20.193.98:0/3024718380 shutdown_connections 2026-02-20T02:27:10.828 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 --2- 10.20.193.98:0/3024718380 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 0x7f53c4075d90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.828 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 --2- 10.20.193.98:0/3024718380 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f53c4106360 0x7f53c4075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.828 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 -- 10.20.193.98:0/3024718380 >> 10.20.193.98:0/3024718380 conn(0x7f53c40fe190 msgr2=0x7f53c41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.828 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 -- 10.20.193.98:0/3024718380 shutdown_connections 2026-02-20T02:27:10.828 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 -- 10.20.193.98:0/3024718380 wait complete. 2026-02-20T02:27:10.828 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 -- 10.20.193.98:0/2053801539 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 msgr2=0x7f4da4108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.829 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 --2- 10.20.193.98:0/2053801539 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 0x7f4da4108a20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d900099b0 tx=0x7f4d9002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.829 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 -- 10.20.193.98:0/2053801539 shutdown_connections 2026-02-20T02:27:10.829 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 --2- 10.20.193.98:0/2053801539 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4da4102640 0x7f4da4102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.829 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 --2- 10.20.193.98:0/2053801539 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 0x7f4da4108a20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.829 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 -- 10.20.193.98:0/2053801539 >> 10.20.193.98:0/2053801539 conn(0x7f4da40fe340 msgr2=0x7f4da4100760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.829 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 -- 10.20.193.98:0/2053801539 shutdown_connections 2026-02-20T02:27:10.829 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 -- 10.20.193.98:0/2053801539 wait complete. 2026-02-20T02:27:10.829 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 Processor -- start 2026-02-20T02:27:10.830 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd34419dcd0 con 0x7fd34410a920 2026-02-20T02:27:10.830 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7fd332ffd640 1 -- 10.20.193.98:0/4241160246 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd338066e60 con 0x7fd34410a920 2026-02-20T02:27:10.830 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 -- start start 2026-02-20T02:27:10.831 INFO:teuthology.orchestra.run.trial098.stdout:210453397506 2026-02-20T02:27:10.831 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4da4102640 0x7f4da41a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.831 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 0x7f4da41a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.831 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4da410f880 con 0x7f4da4108640 2026-02-20T02:27:10.831 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4daa354640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4da410f700 con 0x7f4da4102640 2026-02-20T02:27:10.832 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f53c3fff640 1 Processor -- start 2026-02-20T02:27:10.832 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4da37fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 0x7f4da41a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.832 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4da37fe640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 0x7f4da41a2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44466/0 (socket says 10.20.193.98:44466) 2026-02-20T02:27:10.832 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.825+0000 7f4da37fe640 1 -- 10.20.193.98:0/572670044 learned_addr learned my addr 10.20.193.98:0/572670044 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c3fff640 1 -- start start 2026-02-20T02:27:10.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4da3fff640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4da4102640 0x7f4da41a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c3fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 0x7f53c41a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c3fff640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f53c4106360 0x7f53c41a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c3fff640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4115e50 con 0x7f53c4075950 2026-02-20T02:27:10.834 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c3fff640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4115cd0 con 0x7f53c4106360 2026-02-20T02:27:10.834 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4da37fe640 1 -- 10.20.193.98:0/572670044 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4da4102640 msgr2=0x7f4da41a25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.834 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4da37fe640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4da4102640 0x7f4da41a25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.834 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4da37fe640 1 -- 10.20.193.98:0/572670044 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da419c6c0 con 0x7f4da4108640 2026-02-20T02:27:10.834 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4da37fe640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 0x7f4da41a2b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400e9b0 tx=0x7f4d9400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.835 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c2ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 0x7f53c41a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.835 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c2ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 0x7f53c41a67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44480/0 (socket says 10.20.193.98:44480) 2026-02-20T02:27:10.835 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c2ffd640 1 -- 10.20.193.98:0/4026711 learned_addr learned my addr 10.20.193.98:0/4026711 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.835 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c27fc640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f53c4106360 0x7f53c41a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.836 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4da17fa640 1 -- 10.20.193.98:0/572670044 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4d9400cbe0 con 0x7f4da4108640 2026-02-20T02:27:10.836 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4da17fa640 1 -- 10.20.193.98:0/572670044 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f4d94004540 con 0x7f4da4108640 2026-02-20T02:27:10.836 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da419c9b0 con 0x7f4da4108640 2026-02-20T02:27:10.836 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4da17fa640 1 -- 10.20.193.98:0/572670044 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4d94010430 con 0x7f4da4108640 2026-02-20T02:27:10.836 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da419cf10 con 0x7f4da4108640 2026-02-20T02:27:10.837 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c2ffd640 1 -- 10.20.193.98:0/4026711 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f53c4106360 msgr2=0x7f53c41a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.837 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c2ffd640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f53c4106360 0x7f53c41a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.837 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c2ffd640 1 -- 10.20.193.98:0/4026711 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c41a0990 con 0x7f53c4075950 2026-02-20T02:27:10.837 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53c2ffd640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 0x7f53c41a67d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f53b800d8d0 tx=0x7f53b800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.837 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da4103d80 con 0x7f4da4108640 2026-02-20T02:27:10.838 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.826+0000 7f53a3fff640 1 -- 10.20.193.98:0/4026711 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f53b8014070 con 0x7f53c4075950 2026-02-20T02:27:10.838 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7f53a3fff640 1 -- 10.20.193.98:0/4026711 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f53b80044a0 con 0x7f53c4075950 2026-02-20T02:27:10.838 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c41a0c80 con 0x7f53c4075950 2026-02-20T02:27:10.838 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7f53a3fff640 1 -- 10.20.193.98:0/4026711 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f53b8002dc0 con 0x7f53c4075950 2026-02-20T02:27:10.838 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c41a1210 con 0x7f53c4075950 2026-02-20T02:27:10.838 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c4076b50 con 0x7f53c4075950 2026-02-20T02:27:10.839 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7f4da17fa640 1 -- 10.20.193.98:0/572670044 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f4d940040d0 con 0x7f4da4108640 2026-02-20T02:27:10.839 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd320077550 msgr2=0x7fd320079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.839 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7fd34c1b0640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd320077550 0x7fd320079a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3340097c0 tx=0x7fd33403a040 comp rx=0 tx=0).stop 2026-02-20T02:27:10.840 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 msgr2=0x7fd3441a2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.840 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.827+0000 7fd34c1b0640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 0x7fd3441a2b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd33800ca30 tx=0x7fd33800cf00 comp rx=0 tx=0).stop 2026-02-20T02:27:10.840 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 shutdown_connections 2026-02-20T02:27:10.840 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7fd34c1b0640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd320077550 0x7fd320079a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.840 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7fd34c1b0640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd34410a920 0x7fd3441a2b60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.840 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7fd34c1b0640 1 --2- 10.20.193.98:0/4241160246 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd344104920 0x7fd3441a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.840 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 >> 10.20.193.98:0/4241160246 conn(0x7fd344100620 msgr2=0x7fd3441027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.840 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7f4da17fa640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4d780775a0 0x7f4d78079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.841 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7f4da3fff640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4d780775a0 0x7f4d78079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.841 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7f53a3fff640 1 -- 10.20.193.98:0/4026711 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f53b800b840 con 0x7f53c4075950 2026-02-20T02:27:10.841 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7f4da17fa640 1 -- 10.20.193.98:0/572670044 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f4d94099c90 con 0x7f4da4108640 2026-02-20T02:27:10.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7f4da3fff640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4d780775a0 0x7f4d78079a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4d90004870 tx=0x7f4d900047c0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7f53a3fff640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f53980775f0 0x7f5398079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7f53a3fff640 1 -- 10.20.193.98:0/4026711 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f53b8099910 con 0x7f53c4075950 2026-02-20T02:27:10.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.828+0000 7f53c27fc640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f53980775f0 0x7f5398079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.843 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.829+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 shutdown_connections 2026-02-20T02:27:10.843 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.829+0000 7fd34c1b0640 1 -- 10.20.193.98:0/4241160246 wait complete. 2026-02-20T02:27:10.843 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.829+0000 7f53c27fc640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f53980775f0 0x7f5398079ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005d20 tx=0x7f53ac005c50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.843 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.830+0000 7f4da17fa640 1 -- 10.20.193.98:0/572670044 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4d94066e60 con 0x7f4da4108640 2026-02-20T02:27:10.844 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.832+0000 7f53a3fff640 1 -- 10.20.193.98:0/4026711 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f53b8066a20 con 0x7f53c4075950 2026-02-20T02:27:10.844 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.833+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb73c19dc90 con 0x7fb73c10a920 2026-02-20T02:27:10.844 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.834+0000 7fb72affd640 1 -- 10.20.193.98:0/420614451 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb73c19dc90 con 0x7fb73c10a920 2026-02-20T02:27:10.845 INFO:teuthology.orchestra.run.trial098.stdout:85899345931 2026-02-20T02:27:10.845 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb7180775a0 msgr2=0x7fb718079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb7180775a0 0x7fb718079a60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb72c005ec0 tx=0x7fb72c005e50 comp rx=0 tx=0).stop 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 msgr2=0x7fb73c1a2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 0x7fb73c1a2ba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb73000d900 tx=0x7fb73000ddd0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 shutdown_connections 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb7180775a0 0x7fb718079a60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb73c10a920 0x7fb73c1a2ba0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 --2- 10.20.193.98:0/420614451 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb73c104920 0x7fb73c1a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 >> 10.20.193.98:0/420614451 conn(0x7fb73c100620 msgr2=0x7fb73c101380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 shutdown_connections 2026-02-20T02:27:10.846 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.836+0000 7fb744051640 1 -- 10.20.193.98:0/420614451 wait complete. 2026-02-20T02:27:10.849 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.847+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fead019d220 con 0x7fead0104920 2026-02-20T02:27:10.852 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.850+0000 7feaaffff640 1 -- 10.20.193.98:0/4248031168 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feac408baa0 con 0x7fead0104920 2026-02-20T02:27:10.852 INFO:teuthology.orchestra.run.trial098.stdout:64424509454 2026-02-20T02:27:10.855 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.852+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feaa40775a0 msgr2=0x7feaa4079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.855 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.852+0000 7fead54c2640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feaa40775a0 0x7feaa4079a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fead010a130 tx=0x7feab8008040 comp rx=0 tx=0).stop 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.852+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead0104920 msgr2=0x7fead01a2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.852+0000 7fead54c2640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead0104920 0x7fead01a2630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feac4002410 tx=0x7feac402fe10 comp rx=0 tx=0).stop 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.853+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 shutdown_connections 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.853+0000 7fead54c2640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feaa40775a0 0x7feaa4079a60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.853+0000 7fead54c2640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fead010a920 0x7fead01a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.853+0000 7fead54c2640 1 --2- 10.20.193.98:0/4248031168 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fead0104920 0x7fead01a2630 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.853+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 >> 10.20.193.98:0/4248031168 conn(0x7fead0100620 msgr2=0x7fead0101380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.853+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 shutdown_connections 2026-02-20T02:27:10.856 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.853+0000 7fead54c2640 1 -- 10.20.193.98:0/4248031168 wait complete. 2026-02-20T02:27:10.858 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f8f8ca64640 1 -- 10.20.193.98:0/859758129 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f88101260 msgr2=0x7f8f8810e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.858 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f8f8ca64640 1 --2- 10.20.193.98:0/859758129 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f88101260 0x7f8f8810e830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8f700099e0 tx=0x7f8f7002f260 comp rx=0 tx=0).stop 2026-02-20T02:27:10.858 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f8f8ca64640 1 -- 10.20.193.98:0/859758129 shutdown_connections 2026-02-20T02:27:10.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f8f8ca64640 1 --2- 10.20.193.98:0/859758129 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f88101260 0x7f8f8810e830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f8f8ca64640 1 --2- 10.20.193.98:0/859758129 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f8f881008b0 0x7f8f88100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.863 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f8f8ca64640 1 -- 10.20.193.98:0/859758129 >> 10.20.193.98:0/859758129 conn(0x7f8f880fc540 msgr2=0x7f8f880fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.865 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 -- 10.20.193.98:0/2028504186 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 msgr2=0x7f39d0108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.865 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 --2- 10.20.193.98:0/2028504186 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 0x7f39d0108ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f39c00099b0 tx=0x7f39c002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.865 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 -- 10.20.193.98:0/2028504186 shutdown_connections 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 --2- 10.20.193.98:0/2028504186 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f39d0100a30 0x7f39d0100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 --2- 10.20.193.98:0/2028504186 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 0x7f39d0108ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 -- 10.20.193.98:0/2028504186 >> 10.20.193.98:0/2028504186 conn(0x7f39d00fc960 msgr2=0x7f39d00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 -- 10.20.193.98:0/2028504186 shutdown_connections 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 -- 10.20.193.98:0/2028504186 wait complete. 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 Processor -- start 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.854+0000 7f39d6c59640 1 -- start start 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39d6c59640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f39d0100a30 0x7f39d01a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39d6c59640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 0x7f39d01a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39d6c59640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f39d010f850 con 0x7f39d01086d0 2026-02-20T02:27:10.866 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39d6c59640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f39d010f6d0 con 0x7f39d0100a30 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 0x7f39d01a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 0x7f39d01a2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44530/0 (socket says 10.20.193.98:44530) 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c7fff640 1 -- 10.20.193.98:0/1604742278 learned_addr learned my addr 10.20.193.98:0/1604742278 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39d49ce640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f39d0100a30 0x7f39d01a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c7fff640 1 -- 10.20.193.98:0/1604742278 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f39d0100a30 msgr2=0x7f39d01a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c7fff640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f39d0100a30 0x7f39d01a2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c7fff640 1 -- 10.20.193.98:0/1604742278 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d019c5d0 con 0x7f39d01086d0 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c7fff640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 0x7f39d01a2950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39b800da30 tx=0x7f39b800df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c5ffb640 1 -- 10.20.193.98:0/1604742278 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f39b8014070 con 0x7f39d01086d0 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39d6c59640 1 -- 10.20.193.98:0/1604742278 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d019c8c0 con 0x7f39d01086d0 2026-02-20T02:27:10.867 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c5ffb640 1 -- 10.20.193.98:0/1604742278 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f39b80040d0 con 0x7f39d01086d0 2026-02-20T02:27:10.868 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39c5ffb640 1 -- 10.20.193.98:0/1604742278 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f39b8002d80 con 0x7f39d01086d0 2026-02-20T02:27:10.868 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f39d6c59640 1 -- 10.20.193.98:0/1604742278 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d019ced0 con 0x7f39d01086d0 2026-02-20T02:27:10.868 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f8f8ca64640 1 -- 10.20.193.98:0/859758129 shutdown_connections 2026-02-20T02:27:10.868 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7f8f8ca64640 1 -- 10.20.193.98:0/859758129 wait complete. 2026-02-20T02:27:10.869 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/92765193 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 msgr2=0x7fcd94104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.869 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.855+0000 7fcd9ad2a640 1 --2- 10.20.193.98:0/92765193 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 0x7fcd94104d20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0099b0 tx=0x7fcd7c02f220 comp rx=0 tx=0).stop 2026-02-20T02:27:10.869 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/92765193 shutdown_connections 2026-02-20T02:27:10.869 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7fcd9ad2a640 1 --2- 10.20.193.98:0/92765193 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 0x7fcd94104d20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.869 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7fcd9ad2a640 1 --2- 10.20.193.98:0/92765193 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fcd9410a8c0 0x7fcd9410aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.869 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/92765193 >> 10.20.193.98:0/92765193 conn(0x7fcd941005c0 msgr2=0x7fcd941029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.869 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/92765193 shutdown_connections 2026-02-20T02:27:10.869 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/92765193 wait complete. 2026-02-20T02:27:10.870 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f8ca64640 1 Processor -- start 2026-02-20T02:27:10.870 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f8ca64640 1 -- start start 2026-02-20T02:27:10.870 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f8ca64640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f881008b0 0x7f8f8810e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f8ca64640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f8f88101260 0x7f8f881055b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f8ca64640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88111b00 con 0x7f8f881008b0 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f8ca64640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88111980 con 0x7f8f88101260 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f85d74640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f8f88101260 0x7f8f881055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f85d74640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f8f88101260 0x7f8f881055b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.106:3300/0 says I am v2:10.20.193.98:60820/0 (socket says 10.20.193.98:60820) 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f85d74640 1 -- 10.20.193.98:0/584966057 learned_addr learned my addr 10.20.193.98:0/584966057 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f86575640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f881008b0 0x7f8f8810e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f85d74640 1 -- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f881008b0 msgr2=0x7f8f8810e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7fcd9ad2a640 1 Processor -- start 2026-02-20T02:27:10.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f85d74640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f881008b0 0x7f8f8810e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f85d74640 1 -- 10.20.193.98:0/584966057 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f88105af0 con 0x7f8f88101260 2026-02-20T02:27:10.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7fcd9ad2a640 1 -- start start 2026-02-20T02:27:10.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.856+0000 7f8f86575640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f881008b0 0x7f8f8810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T02:27:10.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f8f85d74640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f8f88101260 0x7f8f881055b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f70005bb0 tx=0x7f8f7002fd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd9ad2a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 0x7fcd941a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd9ad2a640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fcd9410a8c0 0x7fcd941a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd9ad2a640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94111ae0 con 0x7fcd941048c0 2026-02-20T02:27:10.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd9ad2a640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94111960 con 0x7fcd9410a8c0 2026-02-20T02:27:10.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd98a9f640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 0x7fcd941a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd98a9f640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 0x7fcd941a25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44546/0 (socket says 10.20.193.98:44546) 2026-02-20T02:27:10.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd98a9f640 1 -- 10.20.193.98:0/73097760 learned_addr learned my addr 10.20.193.98:0/73097760 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:10.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f8f6f7fe640 1 -- 10.20.193.98:0/584966057 <== mon.1 v2:10.20.193.106:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8f70004420 con 0x7f8f88101260 2026-02-20T02:27:10.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f8f6f7fe640 1 -- 10.20.193.98:0/584966057 <== mon.1 v2:10.20.193.106:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8f70038a40 con 0x7f8f88101260 2026-02-20T02:27:10.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f8f6f7fe640 1 -- 10.20.193.98:0/584966057 <== mon.1 v2:10.20.193.106:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8f700417b0 con 0x7f8f88101260 2026-02-20T02:27:10.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f8f8ca64640 1 -- 10.20.193.98:0/584966057 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f88105d80 con 0x7f8f88101260 2026-02-20T02:27:10.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f8f8ca64640 1 -- 10.20.193.98:0/584966057 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f88106280 con 0x7f8f88101260 2026-02-20T02:27:10.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f39c5ffb640 1 -- 10.20.193.98:0/1604742278 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f39b800bb90 con 0x7f39d01086d0 2026-02-20T02:27:10.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f399f7fe640 1 -- 10.20.193.98:0/1604742278 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d0103e10 con 0x7f39d01086d0 2026-02-20T02:27:10.876 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd8bfff640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fcd9410a8c0 0x7fcd941a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.876 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f39c5ffb640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f39ac077550 0x7f39ac079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.876 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd98a9f640 1 -- 10.20.193.98:0/73097760 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fcd9410a8c0 msgr2=0x7fcd941a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.876 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd98a9f640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fcd9410a8c0 0x7fcd941a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.876 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd98a9f640 1 -- 10.20.193.98:0/73097760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9419c690 con 0x7fcd941048c0 2026-02-20T02:27:10.877 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd8bfff640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fcd9410a8c0 0x7fcd941a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T02:27:10.877 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f39c5ffb640 1 -- 10.20.193.98:0/1604742278 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f39b8099a40 con 0x7f39d01086d0 2026-02-20T02:27:10.877 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7f39d49ce640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f39ac077550 0x7f39ac079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.877 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.857+0000 7fcd98a9f640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 0x7fcd941a25c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400ca30 tx=0x7fcd8400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.878 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.858+0000 7f8f6d7fa640 1 -- 10.20.193.98:0/584966057 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f50005390 con 0x7f8f88101260 2026-02-20T02:27:10.878 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.858+0000 7f8f6f7fe640 1 -- 10.20.193.98:0/584966057 <== mon.1 v2:10.20.193.106:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f8f70038bf0 con 0x7f8f88101260 2026-02-20T02:27:10.878 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.859+0000 7f8f6f7fe640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8f60077340 0x7f8f60079800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.878 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.859+0000 7f8f6f7fe640 1 -- 10.20.193.98:0/584966057 <== mon.1 v2:10.20.193.106:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f8f7003e070 con 0x7f8f88101260 2026-02-20T02:27:10.878 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.859+0000 7f8f86575640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8f60077340 0x7f8f60079800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.878 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.859+0000 7f8f86575640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8f60077340 0x7f8f60079800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c010420 tx=0x7f8f7c0073d0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.879 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.858+0000 7f39d49ce640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f39ac077550 0x7f39ac079a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39c0004870 tx=0x7f39c00047c0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.879 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.860+0000 7f8f6f7fe640 1 -- 10.20.193.98:0/584966057 <== mon.1 v2:10.20.193.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8f7008b6f0 con 0x7f8f88101260 2026-02-20T02:27:10.879 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.861+0000 7f39c5ffb640 1 -- 10.20.193.98:0/1604742278 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f39b8004280 con 0x7f39d01086d0 2026-02-20T02:27:10.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.861+0000 7fcd89ffb640 1 -- 10.20.193.98:0/73097760 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcd84013070 con 0x7fcd941048c0 2026-02-20T02:27:10.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.861+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9419c980 con 0x7fcd941048c0 2026-02-20T02:27:10.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.861+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9419cf10 con 0x7fcd941048c0 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.862+0000 7fcd89ffb640 1 -- 10.20.193.98:0/73097760 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fcd84007da0 con 0x7fcd941048c0 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.862+0000 7fcd89ffb640 1 -- 10.20.193.98:0/73097760 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcd84002e20 con 0x7fcd941048c0 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.862+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd94106000 con 0x7fcd941048c0 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.863+0000 7fcd89ffb640 1 -- 10.20.193.98:0/73097760 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fcd84007930 con 0x7fcd941048c0 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.864+0000 7fcd89ffb640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fcd70077550 0x7fcd70079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.864+0000 7fcd89ffb640 1 -- 10.20.193.98:0/73097760 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fcd84099d40 con 0x7fcd941048c0 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.864+0000 7fcd8bfff640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fcd70077550 0x7fcd70079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.864+0000 7fcd8bfff640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fcd70077550 0x7fcd70079a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd9419dee0 tx=0x7fcd7c03a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:10.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.865+0000 7fcd89ffb640 1 -- 10.20.193.98:0/73097760 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fcd84004440 con 0x7fcd941048c0 2026-02-20T02:27:10.883 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397507 got 210453397506 for osd.7 2026-02-20T02:27:10.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345932 got 85899345931 for osd.2 2026-02-20T02:27:10.894 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:10 trial098 ceph-mon[38923]: pgmap v86: 1 pgs: 1 peering; 0 B data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:10.894 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:10 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1682016429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:10.894 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:10 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4241160246' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T02:27:10.894 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:10 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/420614451' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T02:27:10.895 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509455 got 64424509454 for osd.1 2026-02-20T02:27:10.927 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.924+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4da4102aa0 con 0x7f4da4108640 2026-02-20T02:27:10.927 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.925+0000 7f4da17fa640 1 -- 10.20.193.98:0/572670044 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4d9406bd10 con 0x7f4da4108640 2026-02-20T02:27:10.928 INFO:teuthology.orchestra.run.trial098.stdout:163208757252 2026-02-20T02:27:10.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.925+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f53c41a14c0 con 0x7f53c4075950 2026-02-20T02:27:10.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.925+0000 7f53a3fff640 1 -- 10.20.193.98:0/4026711 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f53b806b8d0 con 0x7f53c4075950 2026-02-20T02:27:10.929 INFO:teuthology.orchestra.run.trial098.stdout:115964117002 2026-02-20T02:27:10.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4d780775a0 msgr2=0x7f4d78079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4d780775a0 0x7f4d78079a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4d90004870 tx=0x7f4d900047c0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 msgr2=0x7f4da41a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 0x7f4da41a2b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400e9b0 tx=0x7f4d9400ee80 comp rx=0 tx=0).stop 2026-02-20T02:27:10.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 shutdown_connections 2026-02-20T02:27:10.931 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4d780775a0 0x7f4d78079a60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.931 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4da4108640 0x7f4da41a2b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.931 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 --2- 10.20.193.98:0/572670044 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4da4102640 0x7f4da41a25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.931 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 >> 10.20.193.98:0/572670044 conn(0x7f4da40fe340 msgr2=0x7f4da40fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.931 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 shutdown_connections 2026-02-20T02:27:10.931 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f4daa354640 1 -- 10.20.193.98:0/572670044 wait complete. 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f53980775f0 msgr2=0x7f5398079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f53980775f0 0x7f5398079ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005d20 tx=0x7f53ac005c50 comp rx=0 tx=0).stop 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 msgr2=0x7f53c41a67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 0x7f53c41a67d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f53b800d8d0 tx=0x7f53b800dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 shutdown_connections 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f53980775f0 0x7f5398079ab0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f53c4106360 0x7f53c41a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 --2- 10.20.193.98:0/4026711 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f53c4075950 0x7f53c41a67d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 >> 10.20.193.98:0/4026711 conn(0x7f53c40fe190 msgr2=0x7f53c4100440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.933 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 shutdown_connections 2026-02-20T02:27:10.933 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.927+0000 7f53c3fff640 1 -- 10.20.193.98:0/4026711 wait complete. 2026-02-20T02:27:10.954 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.951+0000 7f8f6d7fa640 1 -- 10.20.193.98:0/584966057 --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8f50005950 con 0x7f8f88101260 2026-02-20T02:27:10.954 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.951+0000 7f399f7fe640 1 -- 10.20.193.98:0/1604742278 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f39d019db00 con 0x7f39d01086d0 2026-02-20T02:27:10.954 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.952+0000 7f8f6f7fe640 1 -- 10.20.193.98:0/584966057 <== mon.1 v2:10.20.193.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8f700905a0 con 0x7f8f88101260 2026-02-20T02:27:10.955 INFO:teuthology.orchestra.run.trial098.stdout:137438953480 2026-02-20T02:27:10.955 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.952+0000 7f39c5ffb640 1 -- 10.20.193.98:0/1604742278 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f39b8066af0 con 0x7f39d01086d0 2026-02-20T02:27:10.955 INFO:teuthology.orchestra.run.trial098.stdout:188978561027 2026-02-20T02:27:10.956 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 -- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8f60077340 msgr2=0x7f8f60079800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.957 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8f60077340 0x7f8f60079800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c010420 tx=0x7f8f7c0073d0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.957 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 -- 10.20.193.98:0/584966057 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f8f88101260 msgr2=0x7f8f881055b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.957 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f8f88101260 0x7f8f881055b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f70005bb0 tx=0x7f8f7002fd20 comp rx=0 tx=0).stop 2026-02-20T02:27:10.957 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 -- 10.20.193.98:0/584966057 shutdown_connections 2026-02-20T02:27:10.957 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f8f60077340 0x7f8f60079800 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.957 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f8f88101260 0x7f8f881055b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.957 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 --2- 10.20.193.98:0/584966057 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f8f881008b0 0x7f8f8810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.957 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 -- 10.20.193.98:0/584966057 >> 10.20.193.98:0/584966057 conn(0x7f8f880fc540 msgr2=0x7f8f880fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.958 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 -- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f39ac077550 msgr2=0x7f39ac079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.958 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f39ac077550 0x7f39ac079a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39c0004870 tx=0x7f39c00047c0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.958 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 -- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 msgr2=0x7f39d01a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.958 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 0x7f39d01a2950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39b800da30 tx=0x7f39b800df00 comp rx=0 tx=0).stop 2026-02-20T02:27:10.958 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 -- 10.20.193.98:0/584966057 shutdown_connections 2026-02-20T02:27:10.958 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f8f6d7fa640 1 -- 10.20.193.98:0/584966057 wait complete. 2026-02-20T02:27:10.959 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 -- 10.20.193.98:0/1604742278 shutdown_connections 2026-02-20T02:27:10.959 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f39ac077550 0x7f39ac079a10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.959 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f39d01086d0 0x7f39d01a2950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.959 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 --2- 10.20.193.98:0/1604742278 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f39d0100a30 0x7f39d01a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.959 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 -- 10.20.193.98:0/1604742278 >> 10.20.193.98:0/1604742278 conn(0x7f39d00fc960 msgr2=0x7f39d00feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.959 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 -- 10.20.193.98:0/1604742278 shutdown_connections 2026-02-20T02:27:10.960 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.954+0000 7f399f7fe640 1 -- 10.20.193.98:0/1604742278 wait complete. 2026-02-20T02:27:10.961 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.959+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcd9419d230 con 0x7fcd941048c0 2026-02-20T02:27:10.962 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.959+0000 7fcd89ffb640 1 -- 10.20.193.98:0/73097760 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd84066e50 con 0x7fcd941048c0 2026-02-20T02:27:10.962 INFO:teuthology.orchestra.run.trial098.stdout:42949672975 2026-02-20T02:27:10.964 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fcd70077550 msgr2=0x7fcd70079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.964 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fcd70077550 0x7fcd70079a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd9419dee0 tx=0x7fcd7c03a040 comp rx=0 tx=0).stop 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 msgr2=0x7fcd941a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 0x7fcd941a25c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400ca30 tx=0x7fcd8400cf00 comp rx=0 tx=0).stop 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 shutdown_connections 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fcd70077550 0x7fcd70079a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fcd9410a8c0 0x7fcd941a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 --2- 10.20.193.98:0/73097760 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fcd941048c0 0x7fcd941a25c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 >> 10.20.193.98:0/73097760 conn(0x7fcd941005c0 msgr2=0x7fcd941016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 shutdown_connections 2026-02-20T02:27:10.965 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:10.962+0000 7fcd9ad2a640 1 -- 10.20.193.98:0/73097760 wait complete. 2026-02-20T02:27:10.971 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117003 got 115964117002 for osd.3 2026-02-20T02:27:10.974 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757253 got 163208757252 for osd.5 2026-02-20T02:27:10.996 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561028 got 188978561027 for osd.6 2026-02-20T02:27:11.002 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953481 got 137438953480 for osd.4 2026-02-20T02:27:11.009 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672977 got 42949672975 for osd.0 2026-02-20T02:27:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:10 trial106 ceph-mon[44052]: pgmap v86: 1 pgs: 1 peering; 0 B data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:11.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:10 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1682016429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:11.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:10 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4241160246' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T02:27:11.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:10 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/420614451' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T02:27:11.884 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-20T02:27:11.885 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-20T02:27:11.896 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-20T02:27:11.972 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-20T02:27:11.974 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-20T02:27:11.997 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-20T02:27:12.003 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-20T02:27:12.010 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-20T02:27:12.059 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.060 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.105 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:11 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4248031168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-20T02:27:12.105 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:11 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/572670044' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-20T02:27:12.105 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:11 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4026711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T02:27:12.105 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:11 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/584966057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T02:27:12.105 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:11 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1604742278' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T02:27:12.105 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:11 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/73097760' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-20T02:27:12.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:11 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4248031168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-20T02:27:12.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:11 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/572670044' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-20T02:27:12.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:11 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4026711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T02:27:12.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:11 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/584966057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T02:27:12.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:11 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1604742278' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T02:27:12.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:11 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/73097760' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-20T02:27:12.124 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.150 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7f9dfe725640 1 -- 10.20.193.98:0/3001795999 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 msgr2=0x7f9df8104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7f9dfe725640 1 --2- 10.20.193.98:0/3001795999 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 0x7f9df8104d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9de80099b0 tx=0x7f9de802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:12.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7f9dfe725640 1 -- 10.20.193.98:0/3001795999 shutdown_connections 2026-02-20T02:27:12.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7f9dfe725640 1 --2- 10.20.193.98:0/3001795999 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 0x7f9df8104d80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7f9dfe725640 1 --2- 10.20.193.98:0/3001795999 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9df810a920 0x7f9df810ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7f9dfe725640 1 -- 10.20.193.98:0/3001795999 >> 10.20.193.98:0/3001795999 conn(0x7f9df8100620 msgr2=0x7f9df8102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7f9dfe725640 1 -- 10.20.193.98:0/3001795999 shutdown_connections 2026-02-20T02:27:12.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7f9dfe725640 1 -- 10.20.193.98:0/3001795999 wait complete. 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7fb700cc9640 1 -- 10.20.193.98:0/2181174736 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc102640 msgr2=0x7fb6fc102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7fb700cc9640 1 --2- 10.20.193.98:0/2181174736 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc102640 0x7fb6fc102aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40099b0 tx=0x7fb6e402f220 comp rx=0 tx=0).stop 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7fb700cc9640 1 -- 10.20.193.98:0/2181174736 shutdown_connections 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7fb700cc9640 1 --2- 10.20.193.98:0/2181174736 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc102640 0x7fb6fc102aa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7fb700cc9640 1 --2- 10.20.193.98:0/2181174736 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6fc108640 0x7fb6fc108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7fb700cc9640 1 -- 10.20.193.98:0/2181174736 >> 10.20.193.98:0/2181174736 conn(0x7fb6fc0fe360 msgr2=0x7fb6fc100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.168+0000 7fb700cc9640 1 -- 10.20.193.98:0/2181174736 shutdown_connections 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb700cc9640 1 -- 10.20.193.98:0/2181174736 wait complete. 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9dfe725640 1 Processor -- start 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9dfe725640 1 -- start start 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9dfe725640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 0x7f9df81a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9dfe725640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9df810a920 0x7f9df81a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9dfe725640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8111b40 con 0x7f9df8104920 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9dfe725640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9df81119c0 con 0x7f9df810a920 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 0x7f9df81a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 0x7f9df81a2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44572/0 (socket says 10.20.193.98:44572) 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df7fff640 1 -- 10.20.193.98:0/3287934334 learned_addr learned my addr 10.20.193.98:0/3287934334 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb700cc9640 1 Processor -- start 2026-02-20T02:27:12.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df77fe640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9df810a920 0x7f9df81a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb700cc9640 1 -- start start 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df7fff640 1 -- 10.20.193.98:0/3287934334 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9df810a920 msgr2=0x7f9df81a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df7fff640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9df810a920 0x7f9df81a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df7fff640 1 -- 10.20.193.98:0/3287934334 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df819c710 con 0x7f9df8104920 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df77fe640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9df810a920 0x7f9df81a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df7fff640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 0x7f9df81a2640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9de400d8d0 tx=0x7f9de400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb700cc9640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6fc102640 0x7fb6fc075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb700cc9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc108640 0x7fb6fc0758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb700cc9640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc10f8e0 con 0x7fb6fc108640 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb700cc9640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc10f760 con 0x7fb6fc102640 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df57fa640 1 -- 10.20.193.98:0/3287934334 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9de4014070 con 0x7f9df8104920 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb6f9d74640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc108640 0x7fb6fc0758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb6f9d74640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc108640 0x7fb6fc0758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44578/0 (socket says 10.20.193.98:44578) 2026-02-20T02:27:12.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb6f9d74640 1 -- 10.20.193.98:0/1246554195 learned_addr learned my addr 10.20.193.98:0/1246554195 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df57fa640 1 -- 10.20.193.98:0/3287934334 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9de40044a0 con 0x7f9df8104920 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df819ca00 con 0x7f9df8104920 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9df57fa640 1 -- 10.20.193.98:0/3287934334 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9de4002dc0 con 0x7f9df8104920 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df819cf60 con 0x7f9df8104920 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb6fa575640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6fc102640 0x7fb6fc075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb6f9d74640 1 -- 10.20.193.98:0/1246554195 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6fc102640 msgr2=0x7fb6fc075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb6f9d74640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6fc102640 0x7fb6fc075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb6f9d74640 1 -- 10.20.193.98:0/1246554195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc075df0 con 0x7fb6fc108640 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.169+0000 7fb6f9d74640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc108640 0x7fb6fc0758b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4002410 tx=0x7fb6e40028b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.170+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df8106060 con 0x7f9df8104920 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.170+0000 7fb6e37fe640 1 -- 10.20.193.98:0/1246554195 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb6e4004420 con 0x7fb6fc108640 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.170+0000 7fb6e37fe640 1 -- 10.20.193.98:0/1246554195 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb6e4038a40 con 0x7fb6fc108640 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.170+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6fc076080 con 0x7fb6fc108640 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.170+0000 7fb6e37fe640 1 -- 10.20.193.98:0/1246554195 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb6e4041880 con 0x7fb6fc108640 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.170+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6fc1a6c00 con 0x7fb6fc108640 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.170+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc103d80 con 0x7fb6fc108640 2026-02-20T02:27:12.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.170+0000 7f9df57fa640 1 -- 10.20.193.98:0/3287934334 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f9de400b840 con 0x7f9df8104920 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7fb6e37fe640 1 -- 10.20.193.98:0/1246554195 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fb6e4038bf0 con 0x7fb6fc108640 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7f9df57fa640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dcc0775a0 0x7f9dcc079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7f9df77fe640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dcc0775a0 0x7f9dcc079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7f9df57fa640 1 -- 10.20.193.98:0/3287934334 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f9de40998f0 con 0x7f9df8104920 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7fb6e37fe640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6d40775a0 0x7fb6d4079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7fb6fa575640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6d40775a0 0x7fb6d4079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7f9df77fe640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dcc0775a0 0x7f9dcc079a60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9de8004870 tx=0x7f9de80047e0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7fb6e37fe640 1 -- 10.20.193.98:0/1246554195 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fb6e403e070 con 0x7fb6fc108640 2026-02-20T02:27:12.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.171+0000 7fb6fa575640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6d40775a0 0x7fb6d4079a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009990 tx=0x7fb6f0008040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.173+0000 7f9df57fa640 1 -- 10.20.193.98:0/3287934334 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9de4066ac0 con 0x7f9df8104920 2026-02-20T02:27:12.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.176+0000 7fb6e37fe640 1 -- 10.20.193.98:0/1246554195 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb6e408b5d0 con 0x7fb6fc108640 2026-02-20T02:27:12.232 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.233 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.233 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.234 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.242 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.240+0000 7f271b221640 1 -- 10.20.193.98:0/2559359397 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141026a0 msgr2=0x7f2714102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.242 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.240+0000 7f271b221640 1 --2- 10.20.193.98:0/2559359397 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141026a0 0x7f2714102b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0099b0 tx=0x7f26fc02f220 comp rx=0 tx=0).stop 2026-02-20T02:27:12.242 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.240+0000 7f271b221640 1 -- 10.20.193.98:0/2559359397 shutdown_connections 2026-02-20T02:27:12.242 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.240+0000 7f271b221640 1 --2- 10.20.193.98:0/2559359397 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141026a0 0x7f2714102b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.240+0000 7f271b221640 1 --2- 10.20.193.98:0/2559359397 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27141086a0 0x7f2714108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.240+0000 7f271b221640 1 -- 10.20.193.98:0/2559359397 >> 10.20.193.98:0/2559359397 conn(0x7f27140fe3e0 msgr2=0x7f2714100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f271b221640 1 -- 10.20.193.98:0/2559359397 shutdown_connections 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f271b221640 1 -- 10.20.193.98:0/2559359397 wait complete. 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f271b221640 1 Processor -- start 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f271b221640 1 -- start start 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f271b221640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27141026a0 0x7f27141a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f271b221640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141086a0 0x7f27141a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f271b221640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f271410f8c0 con 0x7f27141086a0 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f271b221640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f271410f740 con 0x7f27141026a0 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f270bfff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141086a0 0x7f27141a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f270bfff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141086a0 0x7f27141a2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44596/0 (socket says 10.20.193.98:44596) 2026-02-20T02:27:12.243 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.241+0000 7f270bfff640 1 -- 10.20.193.98:0/3207983448 learned_addr learned my addr 10.20.193.98:0/3207983448 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f2718f96640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27141026a0 0x7f27141a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f270bfff640 1 -- 10.20.193.98:0/3207983448 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27141026a0 msgr2=0x7f27141a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f270bfff640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27141026a0 0x7f27141a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f270bfff640 1 -- 10.20.193.98:0/3207983448 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271419c680 con 0x7f27141086a0 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f270bfff640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141086a0 0x7f27141a2af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009980 tx=0x7f26fc02fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f2709ffb640 1 -- 10.20.193.98:0/3207983448 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f26fc004420 con 0x7f27141086a0 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f2709ffb640 1 -- 10.20.193.98:0/3207983448 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f26fc038a40 con 0x7f27141086a0 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271419c910 con 0x7f27141086a0 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f2709ffb640 1 -- 10.20.193.98:0/3207983448 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f26fc0417e0 con 0x7f27141086a0 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271419ce10 con 0x7f27141086a0 2026-02-20T02:27:12.244 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.242+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2714103de0 con 0x7f27141086a0 2026-02-20T02:27:12.245 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.243+0000 7f2709ffb640 1 -- 10.20.193.98:0/3207983448 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f26fc038bf0 con 0x7f27141086a0 2026-02-20T02:27:12.245 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.244+0000 7f2709ffb640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f26f0077550 0x7f26f0079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.246 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.244+0000 7f2709ffb640 1 -- 10.20.193.98:0/3207983448 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f26fc03e070 con 0x7f27141086a0 2026-02-20T02:27:12.246 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.244+0000 7f2718f96640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f26f0077550 0x7f26f0079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.246 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.244+0000 7f2718f96640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f26f0077550 0x7f26f0079a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2704005e00 tx=0x7f2704005d50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.248 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.246+0000 7f2709ffb640 1 -- 10.20.193.98:0/3207983448 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f26fc08b7e0 con 0x7f27141086a0 2026-02-20T02:27:12.257 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.255+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/3777287923 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0108640 msgr2=0x7fc6a0108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.257 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.255+0000 7fc6a6fb2640 1 --2- 10.20.193.98:0/3777287923 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0108640 0x7fc6a0108a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc6900099b0 tx=0x7fc69002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:12.257 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.255+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/3777287923 shutdown_connections 2026-02-20T02:27:12.257 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.255+0000 7fc6a6fb2640 1 --2- 10.20.193.98:0/3777287923 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc6a0102640 0x7fc6a0102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.257 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.255+0000 7fc6a6fb2640 1 --2- 10.20.193.98:0/3777287923 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0108640 0x7fc6a0108a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.257 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.255+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/3777287923 >> 10.20.193.98:0/3777287923 conn(0x7fc6a00fe360 msgr2=0x7fc6a0100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.258 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.255+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/3777287923 shutdown_connections 2026-02-20T02:27:12.258 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.255+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/3777287923 wait complete. 2026-02-20T02:27:12.258 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a6fb2640 1 Processor -- start 2026-02-20T02:27:12.258 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a6fb2640 1 -- start start 2026-02-20T02:27:12.258 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a6fb2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0102640 0x7fc6a0075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a6fb2640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc6a0108640 0x7fc6a00758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a6fb2640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a010f860 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a6fb2640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a010f6e0 con 0x7fc6a0108640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a4d27640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0102640 0x7fc6a0075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a4d27640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0102640 0x7fc6a0075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44624/0 (socket says 10.20.193.98:44624) 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a4d27640 1 -- 10.20.193.98:0/263678294 learned_addr learned my addr 10.20.193.98:0/263678294 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a4d27640 1 -- 10.20.193.98:0/263678294 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc6a0108640 msgr2=0x7fc6a00758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a4d27640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc6a0108640 0x7fc6a00758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a4d27640 1 -- 10.20.193.98:0/263678294 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a0075df0 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a4d27640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0102640 0x7fc6a0075370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc690009980 tx=0x7fc6900029c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc695ffb640 1 -- 10.20.193.98:0/263678294 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc690046070 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a0076080 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc695ffb640 1 -- 10.20.193.98:0/263678294 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc690038a40 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc695ffb640 1 -- 10.20.193.98:0/263678294 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc6900419a0 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.256+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a01a6b30 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.257+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a0103d80 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.257+0000 7fc695ffb640 1 -- 10.20.193.98:0/263678294 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fc690038bf0 con 0x7fc6a0102640 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.258+0000 7fc695ffb640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc67c077550 0x7fc67c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.259 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.258+0000 7fc695ffb640 1 -- 10.20.193.98:0/263678294 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fc69003e070 con 0x7fc6a0102640 2026-02-20T02:27:12.260 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.258+0000 7fc697fff640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc67c077550 0x7fc67c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.260 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.258+0000 7fc697fff640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc67c077550 0x7fc67c079a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0076e00 tx=0x7fc688005d70 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.262 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.260+0000 7fc695ffb640 1 -- 10.20.193.98:0/263678294 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc69008b3b0 con 0x7fc6a0102640 2026-02-20T02:27:12.271 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.269+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9df8104d80 con 0x7f9df8104920 2026-02-20T02:27:12.272 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.270+0000 7f9df57fa640 1 -- 10.20.193.98:0/3287934334 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9de406b970 con 0x7f9df8104920 2026-02-20T02:27:12.272 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.270+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb6fc10a640 con 0x7fb6fc108640 2026-02-20T02:27:12.272 INFO:teuthology.orchestra.run.trial098.stdout:210453397507 2026-02-20T02:27:12.272 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.270+0000 7fb6e37fe640 1 -- 10.20.193.98:0/1246554195 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6e4090480 con 0x7fb6fc108640 2026-02-20T02:27:12.272 INFO:teuthology.orchestra.run.trial098.stdout:85899345932 2026-02-20T02:27:12.274 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6d40775a0 msgr2=0x7fb6d4079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.274 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7fb700cc9640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6d40775a0 0x7fb6d4079a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009990 tx=0x7fb6f0008040 comp rx=0 tx=0).stop 2026-02-20T02:27:12.274 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc108640 msgr2=0x7fb6fc0758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.274 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7fb700cc9640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc108640 0x7fb6fc0758b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4002410 tx=0x7fb6e40028b0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.274 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 shutdown_connections 2026-02-20T02:27:12.274 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7fb700cc9640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb6d40775a0 0x7fb6d4079a60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7fb700cc9640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb6fc108640 0x7fb6fc0758b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7fb700cc9640 1 --2- 10.20.193.98:0/1246554195 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb6fc102640 0x7fb6fc075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 >> 10.20.193.98:0/1246554195 conn(0x7fb6fc0fe360 msgr2=0x7fb6fc0ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dcc0775a0 msgr2=0x7f9dcc079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7f9dfe725640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dcc0775a0 0x7f9dcc079a60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9de8004870 tx=0x7f9de80047e0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 msgr2=0x7f9df81a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.272+0000 7f9dfe725640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 0x7f9df81a2640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9de400d8d0 tx=0x7f9de400dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 shutdown_connections 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 shutdown_connections 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7f9dfe725640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9dcc0775a0 0x7f9dcc079a60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7f9dfe725640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9df810a920 0x7f9df81a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7f9dfe725640 1 --2- 10.20.193.98:0/3287934334 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9df8104920 0x7f9df81a2640 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 >> 10.20.193.98:0/3287934334 conn(0x7f9df8100620 msgr2=0x7f9df81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 shutdown_connections 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7f9dfe725640 1 -- 10.20.193.98:0/3287934334 wait complete. 2026-02-20T02:27:12.275 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.273+0000 7fb700cc9640 1 -- 10.20.193.98:0/1246554195 wait complete. 2026-02-20T02:27:12.316 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345932 got 85899345932 for osd.2 2026-02-20T02:27:12.316 DEBUG:teuthology.parallel:result is None 2026-02-20T02:27:12.319 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397507 got 210453397507 for osd.7 2026-02-20T02:27:12.319 DEBUG:teuthology.parallel:result is None 2026-02-20T02:27:12.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.338+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f271419d0c0 con 0x7f27141086a0 2026-02-20T02:27:12.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.338+0000 7f2709ffb640 1 -- 10.20.193.98:0/3207983448 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f26fc090690 con 0x7f27141086a0 2026-02-20T02:27:12.340 INFO:teuthology.orchestra.run.trial098.stdout:64424509455 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f26f0077550 msgr2=0x7f26f0079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f26f0077550 0x7f26f0079a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2704005e00 tx=0x7f2704005d50 comp rx=0 tx=0).stop 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141086a0 msgr2=0x7f27141a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141086a0 0x7f27141a2af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009980 tx=0x7f26fc02fdf0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 shutdown_connections 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f26f0077550 0x7f26f0079a10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27141086a0 0x7f27141a2af0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 --2- 10.20.193.98:0/3207983448 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27141026a0 0x7f27141a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 >> 10.20.193.98:0/3207983448 conn(0x7f27140fe3e0 msgr2=0x7f27140ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 shutdown_connections 2026-02-20T02:27:12.342 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.340+0000 7f271b221640 1 -- 10.20.193.98:0/3207983448 wait complete. 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 -- 10.20.193.98:0/3629589535 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101380 msgr2=0x7fec68101760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 --2- 10.20.193.98:0/3629589535 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101380 0x7fec68101760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0099b0 tx=0x7fec5c02f220 comp rx=0 tx=0).stop 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 -- 10.20.193.98:0/3629589535 shutdown_connections 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 --2- 10.20.193.98:0/3629589535 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fec68101ca0 0x7fec6810eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 --2- 10.20.193.98:0/3629589535 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101380 0x7fec68101760 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 -- 10.20.193.98:0/3629589535 >> 10.20.193.98:0/3629589535 conn(0x7fec680783f0 msgr2=0x7fec680ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 -- 10.20.193.98:0/3629589535 shutdown_connections 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 -- 10.20.193.98:0/3629589535 wait complete. 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 Processor -- start 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 -- start start 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fec68101380 0x7fec681a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101ca0 0x7fec681a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fec68111ac0 con 0x7fec68101ca0 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec6d641640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fec68111940 con 0x7fec68101380 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec667fc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101ca0 0x7fec681a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec667fc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101ca0 0x7fec681a2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44646/0 (socket says 10.20.193.98:44646) 2026-02-20T02:27:12.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.347+0000 7fec667fc640 1 -- 10.20.193.98:0/4213646313 learned_addr learned my addr 10.20.193.98:0/4213646313 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec667fc640 1 -- 10.20.193.98:0/4213646313 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fec68101380 msgr2=0x7fec681a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec66ffd640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fec68101380 0x7fec681a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec667fc640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fec68101380 0x7fec681a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec667fc640 1 -- 10.20.193.98:0/4213646313 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6819c630 con 0x7fec68101ca0 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec66ffd640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fec68101380 0x7fec681a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec667fc640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101ca0 0x7fec681a2aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d8d0 tx=0x7fec5000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec47fff640 1 -- 10.20.193.98:0/4213646313 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fec50014070 con 0x7fec68101ca0 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6819c920 con 0x7fec68101ca0 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec47fff640 1 -- 10.20.193.98:0/4213646313 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fec500044a0 con 0x7fec68101ca0 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec47fff640 1 -- 10.20.193.98:0/4213646313 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fec50002dc0 con 0x7fec68101ca0 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6819ce80 con 0x7fec68101ca0 2026-02-20T02:27:12.350 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.348+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6806b010 con 0x7fec68101ca0 2026-02-20T02:27:12.351 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.349+0000 7fec47fff640 1 -- 10.20.193.98:0/4213646313 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fec5000b840 con 0x7fec68101ca0 2026-02-20T02:27:12.351 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.349+0000 7f9b907d7640 1 -- 10.20.193.98:0/2027627024 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101620 msgr2=0x7f9b88101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.351 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.349+0000 7f9b907d7640 1 --2- 10.20.193.98:0/2027627024 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101620 0x7f9b88101a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9b840099b0 tx=0x7f9b8402f2b0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.351 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.349+0000 7f9b907d7640 1 -- 10.20.193.98:0/2027627024 shutdown_connections 2026-02-20T02:27:12.351 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.349+0000 7f9b907d7640 1 --2- 10.20.193.98:0/2027627024 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9b88101f40 0x7f9b88106410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.351 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.349+0000 7f9b907d7640 1 --2- 10.20.193.98:0/2027627024 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101620 0x7f9b88101a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.351 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.349+0000 7f9b907d7640 1 -- 10.20.193.98:0/2027627024 >> 10.20.193.98:0/2027627024 conn(0x7f9b880fd230 msgr2=0x7f9b880ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.351 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fec47fff640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fec3c077550 0x7fec3c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3612456588 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 msgr2=0x7fb9a010ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 --2- 10.20.193.98:0/3612456588 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 0x7fb9a010ad00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb9940099b0 tx=0x7fb99402f220 comp rx=0 tx=0).stop 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3612456588 shutdown_connections 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 --2- 10.20.193.98:0/3612456588 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb9a0104920 0x7fb9a0104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 --2- 10.20.193.98:0/3612456588 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 0x7fb9a010ad00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3612456588 >> 10.20.193.98:0/3612456588 conn(0x7fb9a0100620 msgr2=0x7fb9a0102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3612456588 shutdown_connections 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fec47fff640 1 -- 10.20.193.98:0/4213646313 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fec50099ad0 con 0x7fec68101ca0 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fec66ffd640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fec3c077550 0x7fec3c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b907d7640 1 -- 10.20.193.98:0/2027627024 shutdown_connections 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3612456588 wait complete. 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b907d7640 1 -- 10.20.193.98:0/2027627024 wait complete. 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fec66ffd640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fec3c077550 0x7fec3c079a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec5c004870 tx=0x7fec5c0047e0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 Processor -- start 2026-02-20T02:27:12.352 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b907d7640 1 Processor -- start 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 -- start start 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b907d7640 1 -- start start 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb9a0104920 0x7fb9a01a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 0x7fb9a01a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a0111b40 con 0x7fb9a010a920 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb9a51cc640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a01119c0 con 0x7fb9a0104920 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b907d7640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9b88101620 0x7f9b881a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b907d7640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101f40 0x7f9b881a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b907d7640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9b88116070 con 0x7f9b88101f40 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b907d7640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9b88115ef0 con 0x7f9b88101620 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb99e575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 0x7fb9a01a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb99e575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 0x7fb9a01a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44680/0 (socket says 10.20.193.98:44680) 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7fb99e575640 1 -- 10.20.193.98:0/3869922630 learned_addr learned my addr 10.20.193.98:0/3869922630 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b8dd4b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101f40 0x7f9b881a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b8dd4b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101f40 0x7f9b881a12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44682/0 (socket says 10.20.193.98:44682) 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.350+0000 7f9b8dd4b640 1 -- 10.20.193.98:0/2683636716 learned_addr learned my addr 10.20.193.98:0/2683636716 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.353 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7fb99ed76640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb9a0104920 0x7fb9a01a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7f9b8e54c640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9b88101620 0x7f9b881a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7fb99e575640 1 -- 10.20.193.98:0/3869922630 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb9a0104920 msgr2=0x7fb9a01a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7fb99e575640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb9a0104920 0x7fb9a01a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7fb99e575640 1 -- 10.20.193.98:0/3869922630 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a019c7a0 con 0x7fb9a010a920 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7fb99ed76640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb9a0104920 0x7fb9a01a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7fb99e575640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 0x7fb9a01a2b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb98800d8d0 tx=0x7fb98800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7f9b8dd4b640 1 -- 10.20.193.98:0/2683636716 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9b88101620 msgr2=0x7f9b881a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7f9b8dd4b640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9b88101620 0x7f9b881a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7f9b8dd4b640 1 -- 10.20.193.98:0/2683636716 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b881a1960 con 0x7f9b88101f40 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7f9b8dd4b640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101f40 0x7f9b881a12b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400ca30 tx=0x7f9b7400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.351+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc6a01052c0 con 0x7fc6a0102640 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7fb97ffff640 1 -- 10.20.193.98:0/3869922630 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb988014070 con 0x7fb9a010a920 2026-02-20T02:27:12.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a019ca90 con 0x7fb9a010a920 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7f9b737fe640 1 -- 10.20.193.98:0/2683636716 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9b74013070 con 0x7f9b88101f40 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b881a5700 con 0x7f9b88101f40 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7fc695ffb640 1 -- 10.20.193.98:0/263678294 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc690090260 con 0x7fc6a0102640 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a019d020 con 0x7fb9a010a920 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7fb97ffff640 1 -- 10.20.193.98:0/3869922630 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb9880044a0 con 0x7fb9a010a920 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7fec47fff640 1 -- 10.20.193.98:0/4213646313 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fec50066ae0 con 0x7fec68101ca0 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7fb97ffff640 1 -- 10.20.193.98:0/3869922630 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb98801e060 con 0x7fb9a010a920 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b881a5c90 con 0x7f9b88101f40 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7f9b737fe640 1 -- 10.20.193.98:0/2683636716 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9b74007da0 con 0x7f9b88101f40 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7f9b737fe640 1 -- 10.20.193.98:0/2683636716 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9b7401d060 con 0x7f9b88101f40 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stdout:115964117004 2026-02-20T02:27:12.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a0106060 con 0x7fb9a010a920 2026-02-20T02:27:12.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.353+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8806b580 con 0x7f9b88101f40 2026-02-20T02:27:12.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.354+0000 7f9b737fe640 1 -- 10.20.193.98:0/2683636716 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f9b74007930 con 0x7f9b88101f40 2026-02-20T02:27:12.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.354+0000 7fb97ffff640 1 -- 10.20.193.98:0/3869922630 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fb98800b840 con 0x7fb9a010a920 2026-02-20T02:27:12.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.354+0000 7f9b737fe640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9b640775a0 0x7f9b64079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.355+0000 7f9b8e54c640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9b640775a0 0x7f9b64079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.355+0000 7f9b737fe640 1 -- 10.20.193.98:0/2683636716 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f9b740998f0 con 0x7f9b88101f40 2026-02-20T02:27:12.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.355+0000 7fb97ffff640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb974077550 0x7fb974079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.355+0000 7fb97ffff640 1 -- 10.20.193.98:0/3869922630 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fb988099970 con 0x7fb9a010a920 2026-02-20T02:27:12.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.355+0000 7fb99ed76640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb974077550 0x7fb974079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.355+0000 7f9b8e54c640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9b640775a0 0x7f9b64079a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009980 tx=0x7f9b8403a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.355+0000 7fb99ed76640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb974077550 0x7fb974079a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb994004870 tx=0x7fb9940047e0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.356+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc67c077550 msgr2=0x7fc67c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.356+0000 7fc6a6fb2640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc67c077550 0x7fc67c079a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0076e00 tx=0x7fc688005d70 comp rx=0 tx=0).stop 2026-02-20T02:27:12.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.356+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0102640 msgr2=0x7fc6a0075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.356+0000 7fc6a6fb2640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0102640 0x7fc6a0075370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc690009980 tx=0x7fc6900029c0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.356+0000 7fb97ffff640 1 -- 10.20.193.98:0/3869922630 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb988066aa0 con 0x7fb9a010a920 2026-02-20T02:27:12.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.357+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 shutdown_connections 2026-02-20T02:27:12.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.357+0000 7fc6a6fb2640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc67c077550 0x7fc67c079a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.359 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.357+0000 7fc6a6fb2640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc6a0108640 0x7fc6a00758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.359 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.357+0000 7fc6a6fb2640 1 --2- 10.20.193.98:0/263678294 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc6a0102640 0x7fc6a0075370 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.359 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.357+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 >> 10.20.193.98:0/263678294 conn(0x7fc6a00fe360 msgr2=0x7fc6a01004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.359 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.357+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 shutdown_connections 2026-02-20T02:27:12.359 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.357+0000 7fc6a6fb2640 1 -- 10.20.193.98:0/263678294 wait complete. 2026-02-20T02:27:12.361 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f9b737fe640 1 -- 10.20.193.98:0/2683636716 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9b74066a20 con 0x7f9b88101f40 2026-02-20T02:27:12.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 -- 10.20.193.98:0/3646098406 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 msgr2=0x7f155410ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 --2- 10.20.193.98:0/3646098406 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 0x7f155410ad00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f15480099b0 tx=0x7f154802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:12.363 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 -- 10.20.193.98:0/3646098406 shutdown_connections 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 --2- 10.20.193.98:0/3646098406 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1554104920 0x7f1554104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 --2- 10.20.193.98:0/3646098406 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 0x7f155410ad00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 -- 10.20.193.98:0/3646098406 >> 10.20.193.98:0/3646098406 conn(0x7f1554100620 msgr2=0x7f1554102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 -- 10.20.193.98:0/3646098406 shutdown_connections 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 -- 10.20.193.98:0/3646098406 wait complete. 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.359+0000 7f1559078640 1 Processor -- start 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1559078640 1 -- start start 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1559078640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1554104920 0x7f1554199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1559078640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 0x7f15541996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1559078640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1554111b60 con 0x7f155410a920 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1559078640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15541119e0 con 0x7f1554104920 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1552575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 0x7f15541996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.364 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1552575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 0x7f15541996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44692/0 (socket says 10.20.193.98:44692) 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1552575640 1 -- 10.20.193.98:0/1569256327 learned_addr learned my addr 10.20.193.98:0/1569256327 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1552575640 1 -- 10.20.193.98:0/1569256327 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1554104920 msgr2=0x7f1554199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1552575640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1554104920 0x7f1554199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1552575640 1 -- 10.20.193.98:0/1569256327 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155419fff0 con 0x7f155410a920 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1552575640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 0x7f15541996a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f153c00d900 tx=0x7f153c00ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1533fff640 1 -- 10.20.193.98:0/1569256327 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f153c014070 con 0x7f155410a920 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1533fff640 1 -- 10.20.193.98:0/1569256327 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f153c0044a0 con 0x7f155410a920 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1533fff640 1 -- 10.20.193.98:0/1569256327 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f153c00be00 con 0x7f155410a920 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15541a02e0 con 0x7f155410a920 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.360+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15541a07b0 con 0x7f155410a920 2026-02-20T02:27:12.365 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.361+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1554106060 con 0x7f155410a920 2026-02-20T02:27:12.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.361+0000 7f1533fff640 1 -- 10.20.193.98:0/1569256327 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f153c0047c0 con 0x7f155410a920 2026-02-20T02:27:12.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.362+0000 7f1533fff640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f15280775f0 0x7f1528079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.362+0000 7f1533fff640 1 -- 10.20.193.98:0/1569256327 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f153c099700 con 0x7f155410a920 2026-02-20T02:27:12.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.362+0000 7f1552d76640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f15280775f0 0x7f1528079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.366 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.362+0000 7f1552d76640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f15280775f0 0x7f1528079ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f15480099b0 tx=0x7f1548009660 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.367 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.365+0000 7f1533fff640 1 -- 10.20.193.98:0/1569256327 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f153c066790 con 0x7f155410a920 2026-02-20T02:27:12.383 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509455 got 64424509455 for osd.1 2026-02-20T02:27:12.383 DEBUG:teuthology.parallel:result is None 2026-02-20T02:27:12.400 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117003 got 115964117004 for osd.3 2026-02-20T02:27:12.400 DEBUG:teuthology.parallel:result is None 2026-02-20T02:27:12.445 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.443+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fec6819d0e0 con 0x7fec68101ca0 2026-02-20T02:27:12.446 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.443+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb9a019dd00 con 0x7fb9a010a920 2026-02-20T02:27:12.446 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.444+0000 7fb97ffff640 1 -- 10.20.193.98:0/3869922630 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb9a019dd00 con 0x7fb9a010a920 2026-02-20T02:27:12.447 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.444+0000 7fec47fff640 1 -- 10.20.193.98:0/4213646313 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fec5006b990 con 0x7fec68101ca0 2026-02-20T02:27:12.447 INFO:teuthology.orchestra.run.trial098.stdout:42949672977 2026-02-20T02:27:12.448 INFO:teuthology.orchestra.run.trial098.stdout:163208757254 2026-02-20T02:27:12.448 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb974077550 msgr2=0x7fb974079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.448 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fb9a51cc640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb974077550 0x7fb974079a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb994004870 tx=0x7fb9940047e0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.448 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fec3c077550 msgr2=0x7fec3c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fec6d641640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fec3c077550 0x7fec3c079a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec5c004870 tx=0x7fec5c0047e0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101ca0 msgr2=0x7fec681a2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fec6d641640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101ca0 0x7fec681a2aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d8d0 tx=0x7fec5000dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 msgr2=0x7fb9a01a2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fb9a51cc640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 0x7fb9a01a2b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb98800d8d0 tx=0x7fb98800dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 shutdown_connections 2026-02-20T02:27:12.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fb9a51cc640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fb974077550 0x7fb974079a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fb9a51cc640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fb9a010a920 0x7fb9a01a2b60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.445+0000 7fb9a51cc640 1 --2- 10.20.193.98:0/3869922630 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fb9a0104920 0x7fb9a01a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 >> 10.20.193.98:0/3869922630 conn(0x7fb9a0100620 msgr2=0x7fb9a01027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 shutdown_connections 2026-02-20T02:27:12.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fec6d641640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fec3c077550 0x7fec3c079a10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fec6d641640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fec68101ca0 0x7fec681a2aa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fec6d641640 1 --2- 10.20.193.98:0/4213646313 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fec68101380 0x7fec681a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 >> 10.20.193.98:0/4213646313 conn(0x7fec680783f0 msgr2=0x7fec680ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 shutdown_connections 2026-02-20T02:27:12.451 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fb9a51cc640 1 -- 10.20.193.98:0/3869922630 wait complete. 2026-02-20T02:27:12.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 shutdown_connections 2026-02-20T02:27:12.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.446+0000 7fec6d641640 1 -- 10.20.193.98:0/4213646313 wait complete. 2026-02-20T02:27:12.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.448+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9b881a5fa0 con 0x7f9b88101f40 2026-02-20T02:27:12.452 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.448+0000 7f9b737fe640 1 -- 10.20.193.98:0/2683636716 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9b7406b8d0 con 0x7f9b88101f40 2026-02-20T02:27:12.453 INFO:teuthology.orchestra.run.trial098.stdout:137438953481 2026-02-20T02:27:12.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9b640775a0 msgr2=0x7f9b64079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9b640775a0 0x7f9b64079a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009980 tx=0x7f9b8403a040 comp rx=0 tx=0).stop 2026-02-20T02:27:12.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101f40 msgr2=0x7f9b881a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101f40 0x7f9b881a12b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400ca30 tx=0x7f9b7400cf00 comp rx=0 tx=0).stop 2026-02-20T02:27:12.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 shutdown_connections 2026-02-20T02:27:12.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9b640775a0 0x7f9b64079a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f9b88101f40 0x7f9b881a12b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 --2- 10.20.193.98:0/2683636716 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f9b88101620 0x7f9b881a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.455 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 >> 10.20.193.98:0/2683636716 conn(0x7f9b880fd230 msgr2=0x7f9b88110570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.455 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.450+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 shutdown_connections 2026-02-20T02:27:12.455 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.451+0000 7f9b907d7640 1 -- 10.20.193.98:0/2683636716 wait complete. 2026-02-20T02:27:12.457 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.455+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f155407b1d0 con 0x7f155410a920 2026-02-20T02:27:12.457 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.455+0000 7f1533fff640 1 -- 10.20.193.98:0/1569256327 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f153c06b640 con 0x7f155410a920 2026-02-20T02:27:12.458 INFO:teuthology.orchestra.run.trial098.stdout:188978561028 2026-02-20T02:27:12.460 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f15280775f0 msgr2=0x7f1528079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.460 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f15280775f0 0x7f1528079ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f15480099b0 tx=0x7f1548009660 comp rx=0 tx=0).stop 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 msgr2=0x7f15541996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 0x7f15541996a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f153c00d900 tx=0x7f153c00ddd0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 shutdown_connections 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f15280775f0 0x7f1528079ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f155410a920 0x7f15541996a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 --2- 10.20.193.98:0/1569256327 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1554104920 0x7f1554199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 >> 10.20.193.98:0/1569256327 conn(0x7f1554100620 msgr2=0x7f1554101750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 shutdown_connections 2026-02-20T02:27:12.461 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.458+0000 7f1559078640 1 -- 10.20.193.98:0/1569256327 wait complete. 2026-02-20T02:27:12.491 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672977 got 42949672977 for osd.0 2026-02-20T02:27:12.491 DEBUG:teuthology.parallel:result is None 2026-02-20T02:27:12.496 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757253 got 163208757254 for osd.5 2026-02-20T02:27:12.496 DEBUG:teuthology.parallel:result is None 2026-02-20T02:27:12.499 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953481 got 137438953481 for osd.4 2026-02-20T02:27:12.500 DEBUG:teuthology.parallel:result is None 2026-02-20T02:27:12.504 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561028 got 188978561028 for osd.6 2026-02-20T02:27:12.504 DEBUG:teuthology.parallel:result is None 2026-02-20T02:27:12.504 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-20T02:27:12.504 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T02:27:12.696 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:12.796 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.794+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1029912182 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff88104920 msgr2=0x7eff88104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.794+0000 7eff8d1a9640 1 --2- 10.20.193.98:0/1029912182 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff88104920 0x7eff88104d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7eff700099b0 tx=0x7eff7002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1029912182 shutdown_connections 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 --2- 10.20.193.98:0/1029912182 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff88104920 0x7eff88104d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 --2- 10.20.193.98:0/1029912182 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7eff8810a920 0x7eff8810ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1029912182 >> 10.20.193.98:0/1029912182 conn(0x7eff88100620 msgr2=0x7eff88102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1029912182 shutdown_connections 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1029912182 wait complete. 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 Processor -- start 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 -- start start 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7eff88104920 0x7eff88077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff8810a920 0x7eff88077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff88111b40 con 0x7eff8810a920 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff8d1a9640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7eff881119c0 con 0x7eff88104920 2026-02-20T02:27:12.797 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff86575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff8810a920 0x7eff88077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff86575640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff8810a920 0x7eff88077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44710/0 (socket says 10.20.193.98:44710) 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff86575640 1 -- 10.20.193.98:0/1243538564 learned_addr learned my addr 10.20.193.98:0/1243538564 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff86d76640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7eff88104920 0x7eff88077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff86575640 1 -- 10.20.193.98:0/1243538564 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7eff88104920 msgr2=0x7eff88077600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff86575640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7eff88104920 0x7eff88077600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.795+0000 7eff86575640 1 -- 10.20.193.98:0/1243538564 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8807b7b0 con 0x7eff8810a920 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.796+0000 7eff86575640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff8810a920 0x7eff88077b40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7eff70009980 tx=0x7eff7002fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.796+0000 7eff67fff640 1 -- 10.20.193.98:0/1243538564 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7eff70004420 con 0x7eff8810a920 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.796+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff88078080 con 0x7eff8810a920 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.796+0000 7eff67fff640 1 -- 10.20.193.98:0/1243538564 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7eff70038a40 con 0x7eff8810a920 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.796+0000 7eff67fff640 1 -- 10.20.193.98:0/1243538564 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7eff700417e0 con 0x7eff8810a920 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.796+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff881ab070 con 0x7eff8810a920 2026-02-20T02:27:12.798 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.796+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff88106060 con 0x7eff8810a920 2026-02-20T02:27:12.799 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.797+0000 7eff67fff640 1 -- 10.20.193.98:0/1243538564 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7eff70038bf0 con 0x7eff8810a920 2026-02-20T02:27:12.799 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.797+0000 7eff67fff640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7eff5c077550 0x7eff5c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:12.799 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.797+0000 7eff67fff640 1 -- 10.20.193.98:0/1243538564 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7eff7003e070 con 0x7eff8810a920 2026-02-20T02:27:12.799 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.797+0000 7eff86d76640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7eff5c077550 0x7eff5c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:12.799 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.797+0000 7eff86d76640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7eff5c077550 0x7eff5c079a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff7c007c40 tx=0x7eff7c0073d0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:12.801 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.799+0000 7eff67fff640 1 -- 10.20.193.98:0/1243538564 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7eff7008b840 con 0x7eff8810a920 2026-02-20T02:27:12.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.880+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff880630c0 con 0x7eff5c077550 2026-02-20T02:27:12.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff67fff640 1 -- 10.20.193.98:0/1243538564 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+14561 (secure 0 0 0) 0x7eff880630c0 con 0x7eff5c077550 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stderr:dumped all 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7eff5c077550 msgr2=0x7eff5c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7eff5c077550 0x7eff5c079a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff7c007c40 tx=0x7eff7c0073d0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff8810a920 msgr2=0x7eff88077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff8810a920 0x7eff88077b40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7eff70009980 tx=0x7eff7002fdf0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 shutdown_connections 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7eff5c077550 0x7eff5c079a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7eff8810a920 0x7eff88077b40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 --2- 10.20.193.98:0/1243538564 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7eff88104920 0x7eff88077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:12.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 >> 10.20.193.98:0/1243538564 conn(0x7eff88100620 msgr2=0x7eff88101780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:12.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.881+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 shutdown_connections 2026-02-20T02:27:12.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:12.882+0000 7eff8d1a9640 1 -- 10.20.193.98:0/1243538564 wait complete. 2026-02-20T02:27:12.919 INFO:teuthology.orchestra.run.trial098.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-20T02:27:11.504834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5872025600,"kb_used":221392,"kb_used_data":5612,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":5871804208,"statfs":{"total":6012954214400,"available":6012727508992,"internally_reserved":0,"allocated":5746688,"data_stored":3372776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":220712505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-590368,"num_objects":-2,"num_object_clones":0,"num_object_copies":-6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-76,"num_read_kb":-64,"num_write":-123,"num_write_kb":-2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.339739"},"pg_stats":[{"pgid":"1.0","version":"22'92","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-20T02:27:08.275604+0000","last_change":"2026-02-20T02:27:08.275604+0000","last_active":"2026-02-20T02:27:08.275604+0000","last_peered":"2026-02-20T02:27:08.275604+0000","last_clean":"2026-02-20T02:27:08.275604+0000","last_became_active":"2026-02-20T02:27:08.271896+0000","last_became_peered":"2026-02-20T02:27:08.271896+0000","last_unstale":"2026-02-20T02:27:08.275604+0000","last_undegraded":"2026-02-20T02:27:08.275604+0000","last_fullsized":"2026-02-20T02:27:08.275604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T02:26:22.098551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T02:26:22.098551+0000","last_clean_scrub_stamp":"2026-02-20T02:26:22.098551+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:33:24.504344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397507,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28032,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975168,"statfs":{"total":751619276800,"available":751590572032,"internally_reserved":0,"allocated":1089536,"data_stored":790577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28036,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975164,"statfs":{"total":751619276800,"available":751590567936,"internally_reserved":0,"allocated":1089536,"data_stored":790577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757254,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27452,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975748,"statfs":{"total":751619276800,"available":751591165952,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27460,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975740,"statfs":{"total":751619276800,"available":751591157760,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27452,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975748,"statfs":{"total":751619276800,"available":751591165952,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27456,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975744,"statfs":{"total":751619276800,"available":751591161856,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27464,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975736,"statfs":{"total":751619276800,"available":751591153664,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28040,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975160,"statfs":{"total":751619276800,"available":751590563840,"internally_reserved":0,"allocated":1089536,"data_stored":790577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T02:27:12.919 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3287934334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1246554195' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3207983448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/263678294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4213646313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3869922630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2683636716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T02:27:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:12 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1569256327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T02:27:13.071 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/3287934334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1246554195' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/3207983448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/263678294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4213646313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/3869922630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2683636716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T02:27:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:12 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1569256327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T02:27:13.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 -- 10.20.193.98:0/2922278401 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077f40 msgr2=0x7f1ce8113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 --2- 10.20.193.98:0/2922278401 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077f40 0x7f1ce8113280 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80099b0 tx=0x7f1cd802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:13.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 -- 10.20.193.98:0/2922278401 shutdown_connections 2026-02-20T02:27:13.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 --2- 10.20.193.98:0/2922278401 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077f40 0x7f1ce8113280 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 --2- 10.20.193.98:0/2922278401 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1ce8077620 0x7f1ce8077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 -- 10.20.193.98:0/2922278401 >> 10.20.193.98:0/2922278401 conn(0x7f1ce8100620 msgr2=0x7f1ce8102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:13.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 -- 10.20.193.98:0/2922278401 shutdown_connections 2026-02-20T02:27:13.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 -- 10.20.193.98:0/2922278401 wait complete. 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 Processor -- start 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 -- start start 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077620 0x7f1ce81a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1ce8077f40 0x7f1ce81a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8116090 con 0x7f1ce8077620 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.172+0000 7f1ceea43640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8115f10 con 0x7f1ce8077f40 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077620 0x7f1ce81a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce7fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077620 0x7f1ce81a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44722/0 (socket says 10.20.193.98:44722) 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce7fff640 1 -- 10.20.193.98:0/3096573195 learned_addr learned my addr 10.20.193.98:0/3096573195 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce7fff640 1 -- 10.20.193.98:0/3096573195 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1ce8077f40 msgr2=0x7f1ce81a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce7fff640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1ce8077f40 0x7f1ce81a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce7fff640 1 -- 10.20.193.98:0/3096573195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce81a5660 con 0x7f1ce8077620 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce7fff640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077620 0x7f1ce81a0d90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400e9b0 tx=0x7f1cd400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce57fa640 1 -- 10.20.193.98:0/3096573195 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1cd400cbe0 con 0x7f1ce8077620 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce57fa640 1 -- 10.20.193.98:0/3096573195 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1cd4004540 con 0x7f1ce8077620 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ce57fa640 1 -- 10.20.193.98:0/3096573195 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1cd4010430 con 0x7f1ce8077620 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce81a5950 con 0x7f1ce8077620 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81a5ee0 con 0x7f1ce8077620 2026-02-20T02:27:13.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.173+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce8078d60 con 0x7f1ce8077620 2026-02-20T02:27:13.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.174+0000 7f1ce57fa640 1 -- 10.20.193.98:0/3096573195 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f1cd40040d0 con 0x7f1ce8077620 2026-02-20T02:27:13.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.174+0000 7f1ce57fa640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1cbc0775a0 0x7f1cbc079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.174+0000 7f1ce57fa640 1 -- 10.20.193.98:0/3096573195 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f1cd4099d50 con 0x7f1ce8077620 2026-02-20T02:27:13.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.174+0000 7f1ce77fe640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1cbc0775a0 0x7f1cbc079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:13.178 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.175+0000 7f1ce77fe640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1cbc0775a0 0x7f1cbc079a60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8004870 tx=0x7f1cd8004800 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:13.178 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.176+0000 7f1ce57fa640 1 -- 10.20.193.98:0/3096573195 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1cd4066e60 con 0x7f1ce8077620 2026-02-20T02:27:13.260 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.258+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ce81a6190 con 0x7f1cbc0775a0 2026-02-20T02:27:13.261 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.258+0000 7f1ce57fa640 1 -- 10.20.193.98:0/3096573195 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+14561 (secure 0 0 0) 0x7f1cd8049900 con 0x7f1cbc0775a0 2026-02-20T02:27:13.261 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:13.262 INFO:teuthology.orchestra.run.trial098.stderr:dumped all 2026-02-20T02:27:13.262 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1cbc0775a0 msgr2=0x7f1cbc079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1cbc0775a0 0x7f1cbc079a60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8004870 tx=0x7f1cd8004800 comp rx=0 tx=0).stop 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077620 msgr2=0x7f1ce81a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077620 0x7f1ce81a0d90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400e9b0 tx=0x7f1cd400ee80 comp rx=0 tx=0).stop 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 shutdown_connections 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f1cbc0775a0 0x7f1cbc079a60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f1ce8077f40 0x7f1ce81a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 --2- 10.20.193.98:0/3096573195 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f1ce8077620 0x7f1ce81a0d90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 >> 10.20.193.98:0/3096573195 conn(0x7f1ce8100620 msgr2=0x7f1ce81012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 shutdown_connections 2026-02-20T02:27:13.263 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.259+0000 7f1ceea43640 1 -- 10.20.193.98:0/3096573195 wait complete. 2026-02-20T02:27:13.297 INFO:teuthology.orchestra.run.trial098.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-20T02:27:11.504834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5872025600,"kb_used":221392,"kb_used_data":5612,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":5871804208,"statfs":{"total":6012954214400,"available":6012727508992,"internally_reserved":0,"allocated":5746688,"data_stored":3372776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":220712505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-590368,"num_objects":-2,"num_object_clones":0,"num_object_copies":-6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-76,"num_read_kb":-64,"num_write":-123,"num_write_kb":-2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.339739"},"pg_stats":[{"pgid":"1.0","version":"22'92","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-20T02:27:08.275604+0000","last_change":"2026-02-20T02:27:08.275604+0000","last_active":"2026-02-20T02:27:08.275604+0000","last_peered":"2026-02-20T02:27:08.275604+0000","last_clean":"2026-02-20T02:27:08.275604+0000","last_became_active":"2026-02-20T02:27:08.271896+0000","last_became_peered":"2026-02-20T02:27:08.271896+0000","last_unstale":"2026-02-20T02:27:08.275604+0000","last_undegraded":"2026-02-20T02:27:08.275604+0000","last_fullsized":"2026-02-20T02:27:08.275604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T02:26:22.098551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T02:26:22.098551+0000","last_clean_scrub_stamp":"2026-02-20T02:26:22.098551+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:33:24.504344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397507,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28032,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975168,"statfs":{"total":751619276800,"available":751590572032,"internally_reserved":0,"allocated":1089536,"data_stored":790577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28036,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975164,"statfs":{"total":751619276800,"available":751590567936,"internally_reserved":0,"allocated":1089536,"data_stored":790577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757254,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27452,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975748,"statfs":{"total":751619276800,"available":751591165952,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27460,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975740,"statfs":{"total":751619276800,"available":751591157760,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27452,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975748,"statfs":{"total":751619276800,"available":751591165952,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,1,2,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27456,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975744,"statfs":{"total":751619276800,"available":751591161856,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27464,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975736,"statfs":{"total":751619276800,"available":751591153664,"internally_reserved":0,"allocated":495616,"data_stored":200209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28040,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975160,"statfs":{"total":751619276800,"available":751590563840,"internally_reserved":0,"allocated":1089536,"data_stored":790577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T02:27:13.298 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-20T02:27:13.298 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T02:27:13.298 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-20T02:27:13.298 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph health --format=json 2026-02-20T02:27:13.450 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:13.555 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 -- 10.20.193.98:0/3129355326 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f339010a8e0 msgr2=0x7f339010acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.555 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 --2- 10.20.193.98:0/3129355326 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f339010a8e0 0x7f339010acc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f33800099b0 tx=0x7f338002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:13.555 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 -- 10.20.193.98:0/3129355326 shutdown_connections 2026-02-20T02:27:13.555 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 --2- 10.20.193.98:0/3129355326 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f33901048e0 0x7f3390104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.555 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 --2- 10.20.193.98:0/3129355326 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f339010a8e0 0x7f339010acc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 -- 10.20.193.98:0/3129355326 >> 10.20.193.98:0/3129355326 conn(0x7f3390100580 msgr2=0x7f33901029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 -- 10.20.193.98:0/3129355326 shutdown_connections 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 -- 10.20.193.98:0/3129355326 wait complete. 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 Processor -- start 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 -- start start 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f33901048e0 0x7f33901a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f339010a8e0 0x7f33901a2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3390111b20 con 0x7f33901048e0 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.550+0000 7f3397e48640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f33901119a0 con 0x7f339010a8e0 2026-02-20T02:27:13.556 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3395bbd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f33901048e0 0x7f33901a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3395bbd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f33901048e0 0x7f33901a25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44750/0 (socket says 10.20.193.98:44750) 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3395bbd640 1 -- 10.20.193.98:0/1785291873 learned_addr learned my addr 10.20.193.98:0/1785291873 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3395bbd640 1 -- 10.20.193.98:0/1785291873 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f339010a8e0 msgr2=0x7f33901a2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3395bbd640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f339010a8e0 0x7f33901a2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3395bbd640 1 -- 10.20.193.98:0/1785291873 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339019c6b0 con 0x7f33901048e0 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3395bbd640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f33901048e0 0x7f33901a25e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3380009980 tx=0x7f338002fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f337effd640 1 -- 10.20.193.98:0/1785291873 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3380004420 con 0x7f33901048e0 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f337effd640 1 -- 10.20.193.98:0/1785291873 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f3380038a40 con 0x7f33901048e0 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339019c940 con 0x7f33901048e0 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f337effd640 1 -- 10.20.193.98:0/1785291873 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f33800417e0 con 0x7f33901048e0 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339019ce40 con 0x7f33901048e0 2026-02-20T02:27:13.557 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.551+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3390106020 con 0x7f33901048e0 2026-02-20T02:27:13.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.552+0000 7f337effd640 1 -- 10.20.193.98:0/1785291873 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f3380038bf0 con 0x7f33901048e0 2026-02-20T02:27:13.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.552+0000 7f337effd640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f336c0775a0 0x7f336c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.553+0000 7f33953bc640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f336c0775a0 0x7f336c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:13.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.553+0000 7f337effd640 1 -- 10.20.193.98:0/1785291873 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f338003e070 con 0x7f33901048e0 2026-02-20T02:27:13.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.553+0000 7f33953bc640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f336c0775a0 0x7f336c079a60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3384005fd0 tx=0x7f3384005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:13.558 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.554+0000 7f337effd640 1 -- 10.20.193.98:0/1785291873 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f338008b7d0 con 0x7f33901048e0 2026-02-20T02:27:13.657 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.655+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3390104d40 con 0x7f33901048e0 2026-02-20T02:27:13.657 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.655+0000 7f337effd640 1 -- 10.20.193.98:0/1785291873 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3380090680 con 0x7f33901048e0 2026-02-20T02:27:13.657 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:13.657 INFO:teuthology.orchestra.run.trial098.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f336c0775a0 msgr2=0x7f336c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f336c0775a0 0x7f336c079a60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3384005fd0 tx=0x7f3384005950 comp rx=0 tx=0).stop 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f33901048e0 msgr2=0x7f33901a25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f33901048e0 0x7f33901a25e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3380009980 tx=0x7f338002fdf0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 shutdown_connections 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f336c0775a0 0x7f336c079a60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f339010a8e0 0x7f33901a2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 --2- 10.20.193.98:0/1785291873 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f33901048e0 0x7f33901a25e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 >> 10.20.193.98:0/1785291873 conn(0x7f3390100580 msgr2=0x7f33901016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 shutdown_connections 2026-02-20T02:27:13.658 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.656+0000 7f3397e48640 1 -- 10.20.193.98:0/1785291873 wait complete. 2026-02-20T02:27:13.694 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-20T02:27:13.694 INFO:tasks.cephadm:Setup complete, yielding 2026-02-20T02:27:13.694 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-20T02:27:13.709 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial098.front.sepia.ceph.com 2026-02-20T02:27:13.709 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-20T02:27:13.860 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:13.912 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:13 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1785291873' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-20T02:27:13.970 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 -- 10.20.193.98:0/3133204329 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 msgr2=0x7fc430102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.970 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 --2- 10.20.193.98:0/3133204329 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 0x7fc430102aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4200099b0 tx=0x7fc42002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:13.970 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 -- 10.20.193.98:0/3133204329 shutdown_connections 2026-02-20T02:27:13.970 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 --2- 10.20.193.98:0/3133204329 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc4301038a0 0x7fc430103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.970 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 --2- 10.20.193.98:0/3133204329 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 0x7fc430102aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.970 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 -- 10.20.193.98:0/3133204329 >> 10.20.193.98:0/3133204329 conn(0x7fc4300fde30 msgr2=0x7fc430100270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:13.970 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 -- 10.20.193.98:0/3133204329 shutdown_connections 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 -- 10.20.193.98:0/3133204329 wait complete. 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.965+0000 7fc4372a7640 1 Processor -- start 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc4372a7640 1 -- start start 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc4372a7640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 0x7fc430196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc4372a7640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc4301038a0 0x7fc4301966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc4372a7640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc43010b230 con 0x7fc4301026a0 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc4372a7640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc43010b0b0 con 0x7fc4301038a0 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc43501c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 0x7fc430196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc43501c640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 0x7fc430196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44766/0 (socket says 10.20.193.98:44766) 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc43501c640 1 -- 10.20.193.98:0/3161257670 learned_addr learned my addr 10.20.193.98:0/3161257670 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:13.971 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc43501c640 1 -- 10.20.193.98:0/3161257670 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc4301038a0 msgr2=0x7fc4301966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc43501c640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc4301038a0 0x7fc4301966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc43501c640 1 -- 10.20.193.98:0/3161257670 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc430192c40 con 0x7fc4301026a0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc43501c640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 0x7fc430196170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc420004850 tx=0x7fc420002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc41e7fc640 1 -- 10.20.193.98:0/3161257670 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc4200044e0 con 0x7fc4301026a0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc41e7fc640 1 -- 10.20.193.98:0/3161257670 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc420038a40 con 0x7fc4301026a0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc430192ed0 con 0x7fc4301026a0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc41e7fc640 1 -- 10.20.193.98:0/3161257670 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc4200418e0 con 0x7fc4301026a0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc430193430 con 0x7fc4301026a0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.966+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc430102aa0 con 0x7fc4301026a0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.968+0000 7fc41e7fc640 1 -- 10.20.193.98:0/3161257670 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fc4200385d0 con 0x7fc4301026a0 2026-02-20T02:27:13.972 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.968+0000 7fc41e7fc640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc40c0775a0 0x7fc40c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:13.973 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.968+0000 7fc41e7fc640 1 -- 10.20.193.98:0/3161257670 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fc42003e070 con 0x7fc4301026a0 2026-02-20T02:27:13.973 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.968+0000 7fc43481b640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc40c0775a0 0x7fc40c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:13.973 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.968+0000 7fc43481b640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc40c0775a0 0x7fc40c079a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc424005fd0 tx=0x7fc424005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:13.973 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:13.969+0000 7fc41e7fc640 1 -- 10.20.193.98:0/3161257670 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc42008b890 con 0x7fc4301026a0 2026-02-20T02:27:14.061 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.059+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fc430107d10 con 0x7fc40c0775a0 2026-02-20T02:27:14.062 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.060+0000 7fc41e7fc640 1 -- 10.20.193.98:0/3161257670 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fc430107d10 con 0x7fc40c0775a0 2026-02-20T02:27:14.062 INFO:teuthology.orchestra.run.trial098.stdout:Backend: cephadm 2026-02-20T02:27:14.062 INFO:teuthology.orchestra.run.trial098.stdout:Available: Yes 2026-02-20T02:27:14.063 INFO:teuthology.orchestra.run.trial098.stdout:Paused: No 2026-02-20T02:27:14.063 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc40c0775a0 msgr2=0x7fc40c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc40c0775a0 0x7fc40c079a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc424005fd0 tx=0x7fc424005950 comp rx=0 tx=0).stop 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 msgr2=0x7fc430196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 0x7fc430196170 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc420004850 tx=0x7fc420002820 comp rx=0 tx=0).stop 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 shutdown_connections 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc40c0775a0 0x7fc40c079a60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc4301038a0 0x7fc4301966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 --2- 10.20.193.98:0/3161257670 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc4301026a0 0x7fc430196170 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 >> 10.20.193.98:0/3161257670 conn(0x7fc4300fde30 msgr2=0x7fc430104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:14.064 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 shutdown_connections 2026-02-20T02:27:14.065 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.061+0000 7fc4372a7640 1 -- 10.20.193.98:0/3161257670 wait complete. 2026-02-20T02:27:14.098 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-20T02:27:14.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:13 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1785291873' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-20T02:27:14.251 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:14.354 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.350+0000 7f93c294f640 1 -- 10.20.193.98:0/1144325354 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 msgr2=0x7f93bc104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.350+0000 7f93c294f640 1 --2- 10.20.193.98:0/1144325354 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 0x7f93bc104d20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f93a80099b0 tx=0x7f93a802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:14.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.350+0000 7f93c294f640 1 -- 10.20.193.98:0/1144325354 shutdown_connections 2026-02-20T02:27:14.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.350+0000 7f93c294f640 1 --2- 10.20.193.98:0/1144325354 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f93bc105b20 0x7f93bc105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.350+0000 7f93c294f640 1 --2- 10.20.193.98:0/1144325354 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 0x7f93bc104d20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.350+0000 7f93c294f640 1 -- 10.20.193.98:0/1144325354 >> 10.20.193.98:0/1144325354 conn(0x7f93bc1000b0 msgr2=0x7f93bc1024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:14.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.350+0000 7f93c294f640 1 -- 10.20.193.98:0/1144325354 shutdown_connections 2026-02-20T02:27:14.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.350+0000 7f93c294f640 1 -- 10.20.193.98:0/1144325354 wait complete. 2026-02-20T02:27:14.355 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93c294f640 1 Processor -- start 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93c294f640 1 -- start start 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93c294f640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 0x7f93bc19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93c294f640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f93bc105b20 0x7f93bc19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93c294f640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc10d4d0 con 0x7f93bc104920 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93c294f640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc10d350 con 0x7f93bc105b20 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93bbfff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 0x7f93bc19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93bbfff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 0x7f93bc19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44786/0 (socket says 10.20.193.98:44786) 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93bbfff640 1 -- 10.20.193.98:0/3490323431 learned_addr learned my addr 10.20.193.98:0/3490323431 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93bbfff640 1 -- 10.20.193.98:0/3490323431 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f93bc105b20 msgr2=0x7f93bc19c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93bbfff640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f93bc105b20 0x7f93bc19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93bbfff640 1 -- 10.20.193.98:0/3490323431 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc19cf20 con 0x7f93bc104920 2026-02-20T02:27:14.356 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93bbfff640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 0x7f93bc19c360 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f93a8002410 tx=0x7f93a802fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:14.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93b97fa640 1 -- 10.20.193.98:0/3490323431 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f93a8004420 con 0x7f93bc104920 2026-02-20T02:27:14.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93b97fa640 1 -- 10.20.193.98:0/3490323431 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f93a8038a40 con 0x7f93bc104920 2026-02-20T02:27:14.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc1a1900 con 0x7f93bc104920 2026-02-20T02:27:14.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93b97fa640 1 -- 10.20.193.98:0/3490323431 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f93a80418b0 con 0x7f93bc104920 2026-02-20T02:27:14.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.351+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc1a1f10 con 0x7f93bc104920 2026-02-20T02:27:14.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.353+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93bc104d20 con 0x7f93bc104920 2026-02-20T02:27:14.357 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.353+0000 7f93b97fa640 1 -- 10.20.193.98:0/3490323431 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f93a8038bf0 con 0x7f93bc104920 2026-02-20T02:27:14.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.353+0000 7f93b97fa640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9390077550 0x7f9390079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:14.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.353+0000 7f93bb7fe640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9390077550 0x7f9390079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:14.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.353+0000 7f93b97fa640 1 -- 10.20.193.98:0/3490323431 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f93a803e070 con 0x7f93bc104920 2026-02-20T02:27:14.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.353+0000 7f93bb7fe640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9390077550 0x7f9390079a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93ac005fd0 tx=0x7f93ac005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:14.358 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.355+0000 7f93b97fa640 1 -- 10.20.193.98:0/3490323431 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f93a808b610 con 0x7f93bc104920 2026-02-20T02:27:14.445 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.444+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f93bc0630c0 con 0x7f9390077550 2026-02-20T02:27:14.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93b97fa640 1 -- 10.20.193.98:0/3490323431 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3388 (secure 0 0 0) 0x7f93bc0630c0 con 0x7f9390077550 2026-02-20T02:27:14.450 INFO:teuthology.orchestra.run.trial098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-20T02:27:14.450 INFO:teuthology.orchestra.run.trial098.stdout:alertmanager.trial098 trial098 *:9093,9094 running (87s) 50s ago 110s 29.0M - 0.25.0 c8568f914cd2 7a8f6ca0719a 2026-02-20T02:27:14.450 INFO:teuthology.orchestra.run.trial098.stdout:ceph-exporter.trial098 trial098 *:9926 running (114s) 50s ago 114s 8782k - 19.2.3-700-gf4ef35d9 de93007c0a72 59969add86f0 2026-02-20T02:27:14.450 INFO:teuthology.orchestra.run.trial098.stdout:ceph-exporter.trial106 trial106 *:9926 running (97s) 13s ago 97s 7101k - 19.2.3-700-gf4ef35d9 de93007c0a72 f27e9e119fc0 2026-02-20T02:27:14.450 INFO:teuthology.orchestra.run.trial098.stdout:crash.trial098 trial098 running (113s) 50s ago 113s 7629k - 19.2.3-700-gf4ef35d9 de93007c0a72 e51f5b3b570c 2026-02-20T02:27:14.450 INFO:teuthology.orchestra.run.trial098.stdout:crash.trial106 trial106 running (97s) 13s ago 97s 7629k - 19.2.3-700-gf4ef35d9 de93007c0a72 890579eea8a8 2026-02-20T02:27:14.451 INFO:teuthology.orchestra.run.trial098.stdout:grafana.trial098 trial098 *:3000 running (86s) 50s ago 107s 81.3M - 10.4.0 c8b91775d855 0991abc73da7 2026-02-20T02:27:14.451 INFO:teuthology.orchestra.run.trial098.stdout:mgr.trial098.hiicxh trial098 *:9283,8765,8443 running (2m) 50s ago 2m 543M - 19.2.3-700-gf4ef35d9 de93007c0a72 c1ab458d5bb1 2026-02-20T02:27:14.451 INFO:teuthology.orchestra.run.trial098.stdout:mgr.trial106.gehstk trial106 *:8443,9283,8765 running (95s) 13s ago 95s 488M - 19.2.3-700-gf4ef35d9 de93007c0a72 6f941d64ca93 2026-02-20T02:27:14.451 INFO:teuthology.orchestra.run.trial098.stdout:mon.trial098 trial098 running (2m) 50s ago 2m 47.3M 2048M 19.2.3-700-gf4ef35d9 de93007c0a72 befd98d6a87d 2026-02-20T02:27:14.451 INFO:teuthology.orchestra.run.trial098.stdout:mon.trial106 trial106 running (94s) 13s ago 94s 48.7M 2048M 19.2.3-700-gf4ef35d9 de93007c0a72 3f9951dc7ac0 2026-02-20T02:27:14.451 INFO:teuthology.orchestra.run.trial098.stdout:node-exporter.trial098 trial098 *:9100 running (112s) 50s ago 112s 15.5M - 1.7.0 72c9c2088986 4bbe33702ce6 2026-02-20T02:27:14.452 INFO:teuthology.orchestra.run.trial098.stdout:node-exporter.trial106 trial106 *:9100 running (96s) 13s ago 95s 14.9M - 1.7.0 72c9c2088986 5602ed063c11 2026-02-20T02:27:14.452 INFO:teuthology.orchestra.run.trial098.stdout:osd.0 trial098 running (78s) 50s ago 78s 40.8M 19.2G 19.2.3-700-gf4ef35d9 de93007c0a72 7f54c7acc594 2026-02-20T02:27:14.452 INFO:teuthology.orchestra.run.trial098.stdout:osd.1 trial098 running (69s) 50s ago 69s 40.2M 19.2G 19.2.3-700-gf4ef35d9 de93007c0a72 df3b659e85ac 2026-02-20T02:27:14.452 INFO:teuthology.orchestra.run.trial098.stdout:osd.2 trial098 running (60s) 50s ago 60s 30.2M 19.2G 19.2.3-700-gf4ef35d9 de93007c0a72 f8611f6ac8a0 2026-02-20T02:27:14.452 INFO:teuthology.orchestra.run.trial098.stdout:osd.3 trial098 running (51s) 50s ago 51s 15.0M 19.2G 19.2.3-700-gf4ef35d9 de93007c0a72 b1d99526bd22 2026-02-20T02:27:14.452 INFO:teuthology.orchestra.run.trial098.stdout:osd.4 trial106 running (42s) 13s ago 42s 46.1M 19.9G 19.2.3-700-gf4ef35d9 de93007c0a72 914fd2838bb2 2026-02-20T02:27:14.453 INFO:teuthology.orchestra.run.trial098.stdout:osd.5 trial106 running (32s) 13s ago 32s 37.8M 19.9G 19.2.3-700-gf4ef35d9 de93007c0a72 2e33f8db853b 2026-02-20T02:27:14.453 INFO:teuthology.orchestra.run.trial098.stdout:osd.6 trial106 running (23s) 13s ago 23s 35.3M 19.9G 19.2.3-700-gf4ef35d9 de93007c0a72 adc71ac0d4f0 2026-02-20T02:27:14.453 INFO:teuthology.orchestra.run.trial098.stdout:osd.7 trial106 running (14s) 13s ago 14s 16.3M 19.9G 19.2.3-700-gf4ef35d9 de93007c0a72 37b6f36e4674 2026-02-20T02:27:14.453 INFO:teuthology.orchestra.run.trial098.stdout:prometheus.trial098 trial098 *:9095 running (85s) 50s ago 104s 39.1M - 2.51.0 1d3b7f56885b d20fe5d86c91 2026-02-20T02:27:14.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9390077550 msgr2=0x7f9390079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9390077550 0x7f9390079a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93ac005fd0 tx=0x7f93ac005950 comp rx=0 tx=0).stop 2026-02-20T02:27:14.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 msgr2=0x7f93bc19c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 0x7f93bc19c360 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f93a8002410 tx=0x7f93a802fe10 comp rx=0 tx=0).stop 2026-02-20T02:27:14.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 shutdown_connections 2026-02-20T02:27:14.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f9390077550 0x7f9390079a10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.454 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f93bc105b20 0x7f93bc19c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.455 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 --2- 10.20.193.98:0/3490323431 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f93bc104920 0x7f93bc19c360 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.455 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 >> 10.20.193.98:0/3490323431 conn(0x7f93bc1000b0 msgr2=0x7f93bc1091d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:14.455 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 shutdown_connections 2026-02-20T02:27:14.455 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.448+0000 7f93c294f640 1 -- 10.20.193.98:0/3490323431 wait complete. 2026-02-20T02:27:14.486 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-20T02:27:14.638 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:14.743 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.742+0000 7f385e0a0640 1 -- 10.20.193.98:0/2167053847 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858104930 msgr2=0x7f3858104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.743 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.742+0000 7f385e0a0640 1 --2- 10.20.193.98:0/2167053847 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858104930 0x7f3858104d30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f38440099b0 tx=0x7f384402f220 comp rx=0 tx=0).stop 2026-02-20T02:27:14.743 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.742+0000 7f385e0a0640 1 -- 10.20.193.98:0/2167053847 shutdown_connections 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.742+0000 7f385e0a0640 1 --2- 10.20.193.98:0/2167053847 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3858105b30 0x7f3858105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.742+0000 7f385e0a0640 1 --2- 10.20.193.98:0/2167053847 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858104930 0x7f3858104d30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.742+0000 7f385e0a0640 1 -- 10.20.193.98:0/2167053847 >> 10.20.193.98:0/2167053847 conn(0x7f38581000e0 msgr2=0x7f3858102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.742+0000 7f385e0a0640 1 -- 10.20.193.98:0/2167053847 shutdown_connections 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.742+0000 7f385e0a0640 1 -- 10.20.193.98:0/2167053847 wait complete. 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f385e0a0640 1 Processor -- start 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f385e0a0640 1 -- start start 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f385e0a0640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3858104930 0x7f385819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f385e0a0640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858105b30 0x7f385819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f385e0a0640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f385810d540 con 0x7f3858105b30 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f385e0a0640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f385810d3c0 con 0x7f3858104930 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3856ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858105b30 0x7f385819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3856ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858105b30 0x7f385819c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44808/0 (socket says 10.20.193.98:44808) 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3856ffd640 1 -- 10.20.193.98:0/3742611543 learned_addr learned my addr 10.20.193.98:0/3742611543 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:14.744 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f38577fe640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3858104930 0x7f385819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3856ffd640 1 -- 10.20.193.98:0/3742611543 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3858104930 msgr2=0x7f385819c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3856ffd640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3858104930 0x7f385819c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3856ffd640 1 -- 10.20.193.98:0/3742611543 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385819d030 con 0x7f3858105b30 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f38577fe640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3858104930 0x7f385819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3856ffd640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858105b30 0x7f385819c9b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f384800b700 tx=0x7f384800bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3854ff9640 1 -- 10.20.193.98:0/3742611543 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3848004440 con 0x7f3858105b30 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3854ff9640 1 -- 10.20.193.98:0/3742611543 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f3848010070 con 0x7f3858105b30 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f3854ff9640 1 -- 10.20.193.98:0/3742611543 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f384800c9b0 con 0x7f3858105b30 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38581a1a70 con 0x7f3858105b30 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.743+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38581a2080 con 0x7f3858105b30 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.744+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3858104db0 con 0x7f3858105b30 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.744+0000 7f3854ff9640 1 -- 10.20.193.98:0/3742611543 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f384801d030 con 0x7f3858105b30 2026-02-20T02:27:14.745 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.745+0000 7f3854ff9640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f382c0775a0 0x7f382c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:14.746 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.745+0000 7f3854ff9640 1 -- 10.20.193.98:0/3742611543 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f3848098a40 con 0x7f3858105b30 2026-02-20T02:27:14.746 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.745+0000 7f38577fe640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f382c0775a0 0x7f382c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:14.746 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.745+0000 7f38577fe640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f382c0775a0 0x7f382c079a60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38440097c0 tx=0x7f38440026e0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:14.747 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.746+0000 7f3854ff9640 1 -- 10.20.193.98:0/3742611543 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3848065c60 con 0x7f3858105b30 2026-02-20T02:27:14.836 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.835+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f38580630c0 con 0x7f382c0775a0 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.838+0000 7f3854ff9640 1 -- 10.20.193.98:0/3742611543 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1270 (secure 0 0 0) 0x7f38580630c0 con 0x7f382c0775a0 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:alertmanager ?:9093,9094 1/1 50s ago 2m count:1 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:ceph-exporter ?:9926 2/2 50s ago 2m * 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:crash 2/2 50s ago 2m * 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:grafana ?:3000 1/1 50s ago 2m count:1 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:mgr 2/2 50s ago 2m count:2 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:mon 2/2 50s ago 111s trial098:10.20.193.98=trial098;trial106:10.20.193.106=trial106;count:2 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:node-exporter ?:9100 2/2 50s ago 2m * 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:osd 8 50s ago - 2026-02-20T02:27:14.839 INFO:teuthology.orchestra.run.trial098.stdout:prometheus ?:9095 1/1 50s ago 2m count:1 2026-02-20T02:27:14.841 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f382c0775a0 msgr2=0x7f382c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.841 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f382c0775a0 0x7f382c079a60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38440097c0 tx=0x7f38440026e0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.841 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858105b30 msgr2=0x7f385819c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:14.841 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858105b30 0x7f385819c9b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f384800b700 tx=0x7f384800bbd0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.841 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 shutdown_connections 2026-02-20T02:27:14.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f382c0775a0 0x7f382c079a60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f3858105b30 0x7f385819c9b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 --2- 10.20.193.98:0/3742611543 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f3858104930 0x7f385819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:14.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 >> 10.20.193.98:0/3742611543 conn(0x7f38581000e0 msgr2=0x7f3858109240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:14.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 shutdown_connections 2026-02-20T02:27:14.842 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:14.839+0000 7f385e0a0640 1 -- 10.20.193.98:0/3742611543 wait complete. 2026-02-20T02:27:14.875 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-20T02:27:15.027 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:15.050 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:14 trial098 ceph-mon[38923]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T02:27:15.050 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:14 trial098 ceph-mon[38923]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T02:27:15.050 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:14 trial098 ceph-mon[38923]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:15.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:14 trial106 ceph-mon[44052]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T02:27:15.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:14 trial106 ceph-mon[44052]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T02:27:15.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:14 trial106 ceph-mon[44052]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:15.129 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 -- 10.20.193.98:0/1987509601 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 msgr2=0x7f92801028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 --2- 10.20.193.98:0/1987509601 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 0x7f92801028e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f92700099b0 tx=0x7f927002f260 comp rx=0 tx=0).stop 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 -- 10.20.193.98:0/1987509601 shutdown_connections 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 --2- 10.20.193.98:0/1987509601 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f92801036e0 0x7f9280103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 --2- 10.20.193.98:0/1987509601 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 0x7f92801028e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 -- 10.20.193.98:0/1987509601 >> 10.20.193.98:0/1987509601 conn(0x7f92800fdc70 msgr2=0x7f92801000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 -- 10.20.193.98:0/1987509601 shutdown_connections 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 -- 10.20.193.98:0/1987509601 wait complete. 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 Processor -- start 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 -- start start 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 0x7f9280076da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f92801036e0 0x7f9280075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f928010b090 con 0x7f92801036e0 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9286411640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f928010af10 con 0x7f92801024e0 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9284c0e640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f92801036e0 0x7f9280075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9284c0e640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f92801036e0 0x7f9280075460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44826/0 (socket says 10.20.193.98:44826) 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.128+0000 7f9284c0e640 1 -- 10.20.193.98:0/3987084744 learned_addr learned my addr 10.20.193.98:0/3987084744 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f928540f640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 0x7f9280076da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f9284c0e640 1 -- 10.20.193.98:0/3987084744 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 msgr2=0x7f9280076da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f9284c0e640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 0x7f9280076da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f9284c0e640 1 -- 10.20.193.98:0/3987084744 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92800759a0 con 0x7f92801036e0 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f928540f640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 0x7f9280076da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f9284c0e640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f92801036e0 0x7f9280075460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f927400e9b0 tx=0x7f927400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f926e7fc640 1 -- 10.20.193.98:0/3987084744 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f927400cbe0 con 0x7f92801036e0 2026-02-20T02:27:15.130 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9280075c90 con 0x7f92801036e0 2026-02-20T02:27:15.131 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f926e7fc640 1 -- 10.20.193.98:0/3987084744 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9274004540 con 0x7f92801036e0 2026-02-20T02:27:15.131 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f926e7fc640 1 -- 10.20.193.98:0/3987084744 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9274010430 con 0x7f92801036e0 2026-02-20T02:27:15.131 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92800762a0 con 0x7f92801036e0 2026-02-20T02:27:15.131 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.129+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92801028e0 con 0x7f92801036e0 2026-02-20T02:27:15.131 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.130+0000 7f926e7fc640 1 -- 10.20.193.98:0/3987084744 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f92740040d0 con 0x7f92801036e0 2026-02-20T02:27:15.131 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.130+0000 7f926e7fc640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f925c0775a0 0x7f925c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.131 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.131+0000 7f928540f640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f925c0775a0 0x7f925c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:15.131 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.131+0000 7f926e7fc640 1 -- 10.20.193.98:0/3987084744 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f9274099d50 con 0x7f92801036e0 2026-02-20T02:27:15.132 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.131+0000 7f928540f640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f925c0775a0 0x7f925c079a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92700097c0 tx=0x7f92700023d0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:15.133 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.133+0000 7f926e7fc640 1 -- 10.20.193.98:0/3987084744 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9274066e60 con 0x7f92801036e0 2026-02-20T02:27:15.220 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.218+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f92800630c0 con 0x7f925c0775a0 2026-02-20T02:27:15.220 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.219+0000 7f926e7fc640 1 -- 10.20.193.98:0/3987084744 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+145 (secure 0 0 0) 0x7f92800630c0 con 0x7f925c0775a0 2026-02-20T02:27:15.221 INFO:teuthology.orchestra.run.trial098.stdout:HOST ADDR LABELS STATUS 2026-02-20T02:27:15.221 INFO:teuthology.orchestra.run.trial098.stdout:trial098 10.20.193.98 2026-02-20T02:27:15.221 INFO:teuthology.orchestra.run.trial098.stdout:trial106 10.20.193.106 2026-02-20T02:27:15.221 INFO:teuthology.orchestra.run.trial098.stdout:2 hosts in cluster 2026-02-20T02:27:15.222 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f925c0775a0 msgr2=0x7f925c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.222 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f925c0775a0 0x7f925c079a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92700097c0 tx=0x7f92700023d0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f92801036e0 msgr2=0x7f9280075460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f92801036e0 0x7f9280075460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f927400e9b0 tx=0x7f927400ee80 comp rx=0 tx=0).stop 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 shutdown_connections 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f925c0775a0 0x7f925c079a60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f92801036e0 0x7f9280075460 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 --2- 10.20.193.98:0/3987084744 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f92801024e0 0x7f9280076da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 >> 10.20.193.98:0/3987084744 conn(0x7f92800fdc70 msgr2=0x7f9280106df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 shutdown_connections 2026-02-20T02:27:15.223 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.220+0000 7f9286411640 1 -- 10.20.193.98:0/3987084744 wait complete. 2026-02-20T02:27:15.257 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-20T02:27:15.411 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:15.516 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 -- 10.20.193.98:0/3292057750 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c075a40 msgr2=0x7f4f8c075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.516 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 --2- 10.20.193.98:0/3292057750 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c075a40 0x7f4f8c075ea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4f800099b0 tx=0x7f4f8002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:15.516 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 -- 10.20.193.98:0/3292057750 shutdown_connections 2026-02-20T02:27:15.516 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 --2- 10.20.193.98:0/3292057750 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c075a40 0x7f4f8c075ea0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.516 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 --2- 10.20.193.98:0/3292057750 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4f8c0770a0 0x7f4f8c075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 -- 10.20.193.98:0/3292057750 >> 10.20.193.98:0/3292057750 conn(0x7f4f8c0fde30 msgr2=0x7f4f8c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 -- 10.20.193.98:0/3292057750 shutdown_connections 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 -- 10.20.193.98:0/3292057750 wait complete. 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 Processor -- start 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 -- start start 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4f8c075a40 0x7f4f8c19c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c0770a0 0x7f4f8c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8c10d4a0 con 0x7f4f8c0770a0 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f93770640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8c10d320 con 0x7f4f8c075a40 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f90ce4640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c0770a0 0x7f4f8c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:15.517 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f90ce4640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c0770a0 0x7f4f8c19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44852/0 (socket says 10.20.193.98:44852) 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f90ce4640 1 -- 10.20.193.98:0/3830511665 learned_addr learned my addr 10.20.193.98:0/3830511665 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f90ce4640 1 -- 10.20.193.98:0/3830511665 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4f8c075a40 msgr2=0x7f4f8c19c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f90ce4640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4f8c075a40 0x7f4f8c19c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f90ce4640 1 -- 10.20.193.98:0/3830511665 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8c19cf10 con 0x7f4f8c0770a0 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.513+0000 7f4f90ce4640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c0770a0 0x7f4f8c19c890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4f80002410 tx=0x7f4f8002fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.514+0000 7f4f7a7fc640 1 -- 10.20.193.98:0/3830511665 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4f80004420 con 0x7f4f8c0770a0 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.514+0000 7f4f7a7fc640 1 -- 10.20.193.98:0/3830511665 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f4f80038a40 con 0x7f4f8c0770a0 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.514+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8c1a18f0 con 0x7f4f8c0770a0 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.514+0000 7f4f7a7fc640 1 -- 10.20.193.98:0/3830511665 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4f800418e0 con 0x7f4f8c0770a0 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.514+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f8c1a1f00 con 0x7f4f8c0770a0 2026-02-20T02:27:15.518 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.514+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f8c075ea0 con 0x7f4f8c0770a0 2026-02-20T02:27:15.519 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.515+0000 7f4f7a7fc640 1 -- 10.20.193.98:0/3830511665 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f4f80038bf0 con 0x7f4f8c0770a0 2026-02-20T02:27:15.519 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.515+0000 7f4f7a7fc640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4f68077550 0x7f4f68079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.520 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.515+0000 7f4f914e5640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4f68077550 0x7f4f68079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:15.520 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.515+0000 7f4f7a7fc640 1 -- 10.20.193.98:0/3830511665 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7f4f8003e070 con 0x7f4f8c0770a0 2026-02-20T02:27:15.520 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.516+0000 7f4f914e5640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4f68077550 0x7f4f68079a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c005fd0 tx=0x7f4f7c005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:15.520 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.517+0000 7f4f7a7fc640 1 -- 10.20.193.98:0/3830511665 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4f8008b960 con 0x7f4f8c0770a0 2026-02-20T02:27:15.607 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.606+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4f8c109ca0 con 0x7f4f68077550 2026-02-20T02:27:15.608 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.606+0000 7f4f7a7fc640 1 -- 10.20.193.98:0/3830511665 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+650 (secure 0 0 0) 0x7f4f8c109ca0 con 0x7f4f68077550 2026-02-20T02:27:15.608 INFO:teuthology.orchestra.run.trial098.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-20T02:27:15.608 INFO:teuthology.orchestra.run.trial098.stdout:trial098 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6A9A 1788G No 50s ago Has a FileSystem, LVM detected 2026-02-20T02:27:15.608 INFO:teuthology.orchestra.run.trial098.stdout:trial098 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6A9B 1788G No 50s ago Has a FileSystem, LVM detected 2026-02-20T02:27:15.609 INFO:teuthology.orchestra.run.trial098.stdout:trial106 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_0325108BFBC8 1788G No 13s ago Has a FileSystem, LVM detected 2026-02-20T02:27:15.609 INFO:teuthology.orchestra.run.trial098.stdout:trial106 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_0325108BFDBB 1788G No 13s ago Has a FileSystem, LVM detected 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4f68077550 msgr2=0x7f4f68079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4f68077550 0x7f4f68079a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c005fd0 tx=0x7f4f7c005950 comp rx=0 tx=0).stop 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c0770a0 msgr2=0x7f4f8c19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c0770a0 0x7f4f8c19c890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4f80002410 tx=0x7f4f8002fe10 comp rx=0 tx=0).stop 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 shutdown_connections 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f4f68077550 0x7f4f68079a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f4f8c0770a0 0x7f4f8c19c890 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 --2- 10.20.193.98:0/3830511665 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f4f8c075a40 0x7f4f8c19c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.610 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 >> 10.20.193.98:0/3830511665 conn(0x7f4f8c0fde30 msgr2=0x7f4f8c108580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:15.611 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 shutdown_connections 2026-02-20T02:27:15.611 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.607+0000 7f4f93770640 1 -- 10.20.193.98:0/3830511665 wait complete. 2026-02-20T02:27:15.646 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-20T02:27:15.663 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial098.front.sepia.ceph.com 2026-02-20T02:27:15.664 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- bash -c 'ceph fs volume create foo' 2026-02-20T02:27:15.817 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.926+0000 7fe647e74640 1 -- 10.20.193.98:0/2757688118 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 msgr2=0x7fe640077ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.926+0000 7fe647e74640 1 --2- 10.20.193.98:0/2757688118 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 0x7fe640077ea0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe6300099b0 tx=0x7fe63002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 -- 10.20.193.98:0/2757688118 shutdown_connections 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 --2- 10.20.193.98:0/2757688118 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe640078cf0 0x7fe640079150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 --2- 10.20.193.98:0/2757688118 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 0x7fe640077ea0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 -- 10.20.193.98:0/2757688118 >> 10.20.193.98:0/2757688118 conn(0x7fe6401000b0 msgr2=0x7fe6401024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 -- 10.20.193.98:0/2757688118 shutdown_connections 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 -- 10.20.193.98:0/2757688118 wait complete. 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 Processor -- start 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 -- start start 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 0x7fe6401a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe640078cf0 0x7fe6401a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.928 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe640111a60 con 0x7fe640077aa0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe6401118e0 con 0x7fe640078cf0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe645be9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 0x7fe6401a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe645be9640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 0x7fe6401a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:44864/0 (socket says 10.20.193.98:44864) 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe645be9640 1 -- 10.20.193.98:0/722263826 learned_addr learned my addr 10.20.193.98:0/722263826 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe645be9640 1 -- 10.20.193.98:0/722263826 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe640078cf0 msgr2=0x7fe6401a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe645be9640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe640078cf0 0x7fe6401a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe645be9640 1 -- 10.20.193.98:0/722263826 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6401a14c0 con 0x7fe640077aa0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe645be9640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 0x7fe6401a0900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe630004290 tx=0x7fe6300042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe62effd640 1 -- 10.20.193.98:0/722263826 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe630046070 con 0x7fe640077aa0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe62effd640 1 -- 10.20.193.98:0/722263826 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fe630038c00 con 0x7fe640077aa0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6401a5ea0 con 0x7fe640077aa0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.927+0000 7fe62effd640 1 -- 10.20.193.98:0/722263826 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe630041af0 con 0x7fe640077aa0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.928+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6401a6420 con 0x7fe640077aa0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.928+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe640077f20 con 0x7fe640077aa0 2026-02-20T02:27:15.929 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.929+0000 7fe62effd640 1 -- 10.20.193.98:0/722263826 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fe630038790 con 0x7fe640077aa0 2026-02-20T02:27:15.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.929+0000 7fe62effd640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe61c077550 0x7fe61c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:15.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.929+0000 7fe62effd640 1 -- 10.20.193.98:0/722263826 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5498+0+0 (secure 0 0 0) 0x7fe63003e070 con 0x7fe640077aa0 2026-02-20T02:27:15.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.929+0000 7fe6453e8640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe61c077550 0x7fe61c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:15.930 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.929+0000 7fe6453e8640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe61c077550 0x7fe61c079a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6401a1db0 tx=0x7fe634006d90 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:15.932 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:15.931+0000 7fe62effd640 1 -- 10.20.193.98:0/722263826 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe630050020 con 0x7fe640077aa0 2026-02-20T02:27:16.025 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:16.023+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}) -- 0x7fe6401104a0 con 0x7fe61c077550 2026-02-20T02:27:16.025 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:15 trial098 ceph-mon[38923]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:16.025 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:15 trial098 ceph-mon[38923]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:16.025 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:15 trial098 ceph-mon[38923]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:16.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:15 trial106 ceph-mon[44052]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:16.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:15 trial106 ceph-mon[44052]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:16.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:15 trial106 ceph-mon[44052]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:17.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:16 trial106 ceph-mon[44052]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:17.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:16 trial106 ceph-mon[44052]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:17.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:16 trial106 ceph-mon[44052]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:17.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:16 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]: dispatch 2026-02-20T02:27:17.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:16 trial098 ceph-mon[38923]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:17.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:16 trial098 ceph-mon[38923]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:17.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:16 trial098 ceph-mon[38923]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:17.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:16 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]: dispatch 2026-02-20T02:27:17.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.878+0000 7fe62effd640 1 -- 10.20.193.98:0/722263826 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe6401104a0 con 0x7fe61c077550 2026-02-20T02:27:17.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe61c077550 msgr2=0x7fe61c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:17.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe61c077550 0x7fe61c079a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6401a1db0 tx=0x7fe634006d90 comp rx=0 tx=0).stop 2026-02-20T02:27:17.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 msgr2=0x7fe6401a0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:17.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 0x7fe6401a0900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe630004290 tx=0x7fe6300042c0 comp rx=0 tx=0).stop 2026-02-20T02:27:17.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 shutdown_connections 2026-02-20T02:27:17.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe61c077550 0x7fe61c079a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:17.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe640078cf0 0x7fe6401a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:17.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 --2- 10.20.193.98:0/722263826 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe640077aa0 0x7fe6401a0900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:17.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 >> 10.20.193.98:0/722263826 conn(0x7fe6401000b0 msgr2=0x7fe64010ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:17.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 shutdown_connections 2026-02-20T02:27:17.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:17.880+0000 7fe647e74640 1 -- 10.20.193.98:0/722263826 wait complete. 2026-02-20T02:27:17.920 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- bash -c 'ceph fs volume create bar' 2026-02-20T02:27:18.074 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:18.121 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:17 trial098 ceph-mon[38923]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:18.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:17 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2026-02-20T02:27:18.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:17 trial098 ceph-mon[38923]: osdmap e51: 8 total, 8 up, 8 in 2026-02-20T02:27:18.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:17 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]: dispatch 2026-02-20T02:27:18.122 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:17 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098[38919]: 2026-02-20T02:27:17.872+0000 7fb818b5d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T02:27:18.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 -- 10.20.193.98:0/4011372962 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038105b30 msgr2=0x7f5038105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:18.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 --2- 10.20.193.98:0/4011372962 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038105b30 0x7f5038105fb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f50280099b0 tx=0x7f502802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:18.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 -- 10.20.193.98:0/4011372962 shutdown_connections 2026-02-20T02:27:18.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 --2- 10.20.193.98:0/4011372962 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038105b30 0x7f5038105fb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:18.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 --2- 10.20.193.98:0/4011372962 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5038104930 0x7f5038104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:18.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 -- 10.20.193.98:0/4011372962 >> 10.20.193.98:0/4011372962 conn(0x7f50381000c0 msgr2=0x7f5038102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:18.173 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 -- 10.20.193.98:0/4011372962 shutdown_connections 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 -- 10.20.193.98:0/4011372962 wait complete. 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 Processor -- start 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 -- start start 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038104930 0x7f503819c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5038105b30 0x7f503819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f503810d4e0 con 0x7f5038104930 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f503e696640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f503810d360 con 0x7f5038105b30 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f5037fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038104930 0x7f503819c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f5037fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038104930 0x7f503819c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60550/0 (socket says 10.20.193.98:60550) 2026-02-20T02:27:18.174 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f5037fff640 1 -- 10.20.193.98:0/133949185 learned_addr learned my addr 10.20.193.98:0/133949185 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f50377fe640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5038105b30 0x7f503819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f5037fff640 1 -- 10.20.193.98:0/133949185 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5038105b30 msgr2=0x7f503819c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f5037fff640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5038105b30 0x7f503819c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.170+0000 7f5037fff640 1 -- 10.20.193.98:0/133949185 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503819cef0 con 0x7f5038104930 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.171+0000 7f5037fff640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038104930 0x7f503819c330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f502400d900 tx=0x7f502400ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.171+0000 7f50357fa640 1 -- 10.20.193.98:0/133949185 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5024014070 con 0x7f5038104930 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.171+0000 7f50357fa640 1 -- 10.20.193.98:0/133949185 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f50240044a0 con 0x7f5038104930 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.171+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50381a1930 con 0x7f5038104930 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.171+0000 7f50357fa640 1 -- 10.20.193.98:0/133949185 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5024002c30 con 0x7f5038104930 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.171+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50381a1f40 con 0x7f5038104930 2026-02-20T02:27:18.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.171+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5038104d30 con 0x7f5038104930 2026-02-20T02:27:18.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.172+0000 7f50357fa640 1 -- 10.20.193.98:0/133949185 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f502400b840 con 0x7f5038104930 2026-02-20T02:27:18.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.172+0000 7f50357fa640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f500c0775a0 0x7f500c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:18.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.173+0000 7f50357fa640 1 -- 10.20.193.98:0/133949185 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6316+0+0 (secure 0 0 0) 0x7f5024099cf0 con 0x7f5038104930 2026-02-20T02:27:18.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.173+0000 7f50377fe640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f500c0775a0 0x7f500c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:18.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.173+0000 7f50377fe640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f500c0775a0 0x7f500c079a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5028002af0 tx=0x7f502803a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:18.177 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.175+0000 7f50357fa640 1 -- 10.20.193.98:0/133949185 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5024066b90 con 0x7f5038104930 2026-02-20T02:27:18.277 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:18.275+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 --> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}) -- 0x7f50380630c0 con 0x7f500c0775a0 2026-02-20T02:27:18.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:17 trial106 ceph-mon[44052]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:17 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2026-02-20T02:27:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:17 trial106 ceph-mon[44052]: osdmap e51: 8 total, 8 up, 8 in 2026-02-20T02:27:18.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:17 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]: dispatch 2026-02-20T02:27:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: pgmap v91: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-20T02:27:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2026-02-20T02:27:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: osdmap e52: 8 total, 8 up, 8 in 2026-02-20T02:27:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]: dispatch 2026-02-20T02:27:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T02:27:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: osdmap e53: 8 total, 8 up, 8 in 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: fsmap foo:0 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.trial098.qfxvya", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial098.qfxvya", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:19.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]: dispatch 2026-02-20T02:27:19.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:27:19.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.trial106.alrimh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T02:27:19.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial106.alrimh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T02:27:19.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: pgmap v91: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: osdmap e52: 8 total, 8 up, 8 in 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]: dispatch 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: osdmap e53: 8 total, 8 up, 8 in 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: fsmap foo:0 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.trial098.qfxvya", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial098.qfxvya", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]: dispatch 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:19.195 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.trial106.alrimh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T02:27:19.196 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial106.alrimh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T02:27:19.196 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:20.127 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: Saving service mds.foo spec with placement count:2 2026-02-20T02:27:20.127 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: Deploying daemon mds.foo.trial098.qfxvya on trial098 2026-02-20T02:27:20.127 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:20.127 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: Deploying daemon mds.foo.trial106.alrimh on trial106 2026-02-20T02:27:20.127 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]': finished 2026-02-20T02:27:20.127 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: osdmap e54: 8 total, 8 up, 8 in 2026-02-20T02:27:20.127 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]: dispatch 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: pgmap v95: 97 pgs: 8 active+clean, 22 creating+peering, 67 unknown; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.98:6834/390933865,v1:10.20.193.98:6835/390933865] up:boot 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] up:boot 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: daemon mds.foo.trial106.alrimh assigned to filesystem foo as rank 0 (now has 1 ranks) 2026-02-20T02:27:20.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-20T02:27:20.129 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-20T02:27:20.129 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: fsmap foo:0 2 up:standby 2026-02-20T02:27:20.129 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "foo.trial098.qfxvya"}]: dispatch 2026-02-20T02:27:20.129 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "foo.trial106.alrimh"}]: dispatch 2026-02-20T02:27:20.129 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: fsmap foo:1 {0=foo.trial106.alrimh=up:creating} 1 up:standby 2026-02-20T02:27:20.129 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:19 trial098 ceph-mon[38923]: daemon mds.foo.trial106.alrimh is now active in filesystem foo as rank 0 2026-02-20T02:27:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: Saving service mds.foo spec with placement count:2 2026-02-20T02:27:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: Deploying daemon mds.foo.trial098.qfxvya on trial098 2026-02-20T02:27:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T02:27:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: Deploying daemon mds.foo.trial106.alrimh on trial106 2026-02-20T02:27:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]': finished 2026-02-20T02:27:20.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: osdmap e54: 8 total, 8 up, 8 in 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]: dispatch 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: pgmap v95: 97 pgs: 8 active+clean, 22 creating+peering, 67 unknown; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.98:6834/390933865,v1:10.20.193.98:6835/390933865] up:boot 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] up:boot 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: daemon mds.foo.trial106.alrimh assigned to filesystem foo as rank 0 (now has 1 ranks) 2026-02-20T02:27:20.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-20T02:27:20.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-20T02:27:20.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: fsmap foo:0 2 up:standby 2026-02-20T02:27:20.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "foo.trial098.qfxvya"}]: dispatch 2026-02-20T02:27:20.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "foo.trial106.alrimh"}]: dispatch 2026-02-20T02:27:20.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: fsmap foo:1 {0=foo.trial106.alrimh=up:creating} 1 up:standby 2026-02-20T02:27:20.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:19 trial106 ceph-mon[44052]: daemon mds.foo.trial106.alrimh is now active in filesystem foo as rank 0 2026-02-20T02:27:20.532 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.530+0000 7f50357fa640 1 -- 10.20.193.98:0/133949185 <== mgr.14205 v2:10.20.193.98:6800/4172434185 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f50380630c0 con 0x7f500c0775a0 2026-02-20T02:27:20.533 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f500c0775a0 msgr2=0x7f500c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:20.533 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f500c0775a0 0x7f500c079a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5028002af0 tx=0x7f502803a040 comp rx=0 tx=0).stop 2026-02-20T02:27:20.534 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038104930 msgr2=0x7f503819c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:20.534 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038104930 0x7f503819c330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f502400d900 tx=0x7f502400ddd0 comp rx=0 tx=0).stop 2026-02-20T02:27:20.534 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 shutdown_connections 2026-02-20T02:27:20.535 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f500c0775a0 0x7f500c079a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:20.535 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f5038105b30 0x7f503819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:20.535 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 --2- 10.20.193.98:0/133949185 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f5038104930 0x7f503819c330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:20.535 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 >> 10.20.193.98:0/133949185 conn(0x7f50381000c0 msgr2=0x7f50381091b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:20.535 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 shutdown_connections 2026-02-20T02:27:20.535 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:20.532+0000 7f503e696640 1 -- 10.20.193.98:0/133949185 wait complete. 2026-02-20T02:27:20.573 INFO:teuthology.run_tasks:Running task fs.ready... 2026-02-20T02:27:20.593 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T02:27:20.781 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:21.013 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.010+0000 7f6836ec1640 1 -- 10.20.193.98:0/2607785379 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 msgr2=0x7f683010ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.010+0000 7f6836ec1640 1 --2- 10.20.193.98:0/2607785379 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 0x7f683010ebb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f68180099b0 tx=0x7f681802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.010+0000 7f6836ec1640 1 -- 10.20.193.98:0/2607785379 shutdown_connections 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.010+0000 7f6836ec1640 1 --2- 10.20.193.98:0/2607785379 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 0x7f683010ebb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.010+0000 7f6836ec1640 1 --2- 10.20.193.98:0/2607785379 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f68301013c0 0x7f68301017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.010+0000 7f6836ec1640 1 -- 10.20.193.98:0/2607785379 >> 10.20.193.98:0/2607785379 conn(0x7f68300fd210 msgr2=0x7f68300ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.010+0000 7f6836ec1640 1 -- 10.20.193.98:0/2607785379 shutdown_connections 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.010+0000 7f6836ec1640 1 -- 10.20.193.98:0/2607785379 wait complete. 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6836ec1640 1 Processor -- start 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6836ec1640 1 -- start start 2026-02-20T02:27:21.014 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6836ec1640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f68301013c0 0x7f68301a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6836ec1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 0x7f68301a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6836ec1640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6830111b00 con 0x7f6830101ce0 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6836ec1640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6830111980 con 0x7f68301013c0 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6827fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 0x7f68301a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6827fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 0x7f68301a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60584/0 (socket says 10.20.193.98:60584) 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6827fff640 1 -- 10.20.193.98:0/388076077 learned_addr learned my addr 10.20.193.98:0/388076077 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6834c36640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f68301013c0 0x7f68301a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6827fff640 1 -- 10.20.193.98:0/388076077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f68301013c0 msgr2=0x7f68301a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6827fff640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f68301013c0 0x7f68301a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6827fff640 1 -- 10.20.193.98:0/388076077 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683019c6f0 con 0x7f6830101ce0 2026-02-20T02:27:21.015 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6834c36640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f68301013c0 0x7f68301a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T02:27:21.016 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6827fff640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 0x7f68301a2b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6818009980 tx=0x7f681802fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:21.016 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6825ffb640 1 -- 10.20.193.98:0/388076077 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6818004420 con 0x7f6830101ce0 2026-02-20T02:27:21.016 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683019c980 con 0x7f6830101ce0 2026-02-20T02:27:21.016 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6825ffb640 1 -- 10.20.193.98:0/388076077 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6818038a40 con 0x7f6830101ce0 2026-02-20T02:27:21.016 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6825ffb640 1 -- 10.20.193.98:0/388076077 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f68180417e0 con 0x7f6830101ce0 2026-02-20T02:27:21.016 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.011+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683019ce80 con 0x7f6830101ce0 2026-02-20T02:27:21.016 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.012+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683006b520 con 0x7f6830101ce0 2026-02-20T02:27:21.017 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.013+0000 7f6825ffb640 1 -- 10.20.193.98:0/388076077 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f6818038bf0 con 0x7f6830101ce0 2026-02-20T02:27:21.017 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.013+0000 7f6825ffb640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f680c077550 0x7f680c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.017 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.013+0000 7f6834c36640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f680c077550 0x7f680c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.017 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.013+0000 7f6825ffb640 1 -- 10.20.193.98:0/388076077 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7134+0+0 (secure 0 0 0) 0x7f681803e070 con 0x7f6830101ce0 2026-02-20T02:27:21.018 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.013+0000 7f6834c36640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f680c077550 0x7f680c079a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68200059c0 tx=0x7f6820005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:21.018 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.015+0000 7f6825ffb640 1 -- 10.20.193.98:0/388076077 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f681808b7f0 con 0x7f6830101ce0 2026-02-20T02:27:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]': finished 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: osdmap e55: 8 total, 8 up, 8 in 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]: dispatch 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: daemon mds.foo.trial098.qfxvya assigned to filesystem bar as rank 0 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: osdmap e56: 8 total, 8 up, 8 in 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]': finished 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] up:active 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: fsmap foo:1 bar:1 {bar:0=foo.trial098.qfxvya=up:creating,foo:0=foo.trial106.alrimh=up:active} 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: Saving service mds.bar spec with placement count:2 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:21.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:21.067 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:21.067 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: daemon mds.foo.trial098.qfxvya is now active in filesystem bar as rank 0 2026-02-20T02:27:21.067 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.067 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.trial098.pnrgwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T02:27:21.067 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial098.pnrgwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T02:27:21.067 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:21.067 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:20 trial098 ceph-mon[38923]: Deploying daemon mds.bar.trial098.pnrgwl on trial098 2026-02-20T02:27:21.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.118+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f683019d130 con 0x7f6830101ce0 2026-02-20T02:27:21.120 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.119+0000 7f6825ffb640 1 -- 10.20.193.98:0/388076077 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+4915 (secure 0 0 0) 0x7f68180906a0 con 0x7f6830101ce0 2026-02-20T02:27:21.121 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:21.121 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":5,"btime":"2026-02-20T02:27:20:525851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T02:27:17.873288+0000","modified":"2026-02-20T02:27:20.525848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24325":{"gid":24325,"name":"foo.trial106.alrimh","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"10.20.193.106:6833/3928932355","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6832","nonce":3928932355},{"type":"v1","addr":"10.20.193.106:6833","nonce":3928932355}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24325,"qdb_cluster":[24325]},"id":1},{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T02:27:19.880373+0000","modified":"2026-02-20T02:27:19.880395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14550":{"gid":14550,"name":"foo.trial098.qfxvya","rank":0,"incarnation":5,"state":"up:creating","state_seq":1,"addr":"10.20.193.98:6835/390933865","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6834","nonce":390933865},{"type":"v1","addr":"10.20.193.98:6835","nonce":390933865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2026-02-20T02:27:21.121 INFO:teuthology.orchestra.run.trial098.stderr:dumped fsmap epoch 5 2026-02-20T02:27:21.122 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.120+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f680c077550 msgr2=0x7f680c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.122 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.120+0000 7f6836ec1640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f680c077550 0x7f680c079a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68200059c0 tx=0x7f6820005950 comp rx=0 tx=0).stop 2026-02-20T02:27:21.122 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.120+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 msgr2=0x7f68301a2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.122 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.120+0000 7f6836ec1640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 0x7f68301a2b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6818009980 tx=0x7f681802fdf0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.122 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.121+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 shutdown_connections 2026-02-20T02:27:21.122 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.121+0000 7f6836ec1640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f680c077550 0x7f680c079a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.123 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.121+0000 7f6836ec1640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f6830101ce0 0x7f68301a2b60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.123 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.121+0000 7f6836ec1640 1 --2- 10.20.193.98:0/388076077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f68301013c0 0x7f68301a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.123 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.121+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 >> 10.20.193.98:0/388076077 conn(0x7f68300fd210 msgr2=0x7f68300fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:21.123 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.121+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 shutdown_connections 2026-02-20T02:27:21.123 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.122+0000 7f6836ec1640 1 -- 10.20.193.98:0/388076077 wait complete. 2026-02-20T02:27:21.188 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T02:27:21.353 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]': finished 2026-02-20T02:27:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: osdmap e55: 8 total, 8 up, 8 in 2026-02-20T02:27:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]: dispatch 2026-02-20T02:27:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: daemon mds.foo.trial098.qfxvya assigned to filesystem bar as rank 0 2026-02-20T02:27:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: osdmap e56: 8 total, 8 up, 8 in 2026-02-20T02:27:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]': finished 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] up:active 2026-02-20T02:27:21.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: fsmap foo:1 bar:1 {bar:0=foo.trial098.qfxvya=up:creating,foo:0=foo.trial106.alrimh=up:active} 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: Saving service mds.bar spec with placement count:2 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: daemon mds.foo.trial098.qfxvya is now active in filesystem bar as rank 0 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.trial098.pnrgwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial098.pnrgwl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:21.370 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:20 trial106 ceph-mon[44052]: Deploying daemon mds.bar.trial098.pnrgwl on trial098 2026-02-20T02:27:21.463 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 -- 10.20.193.98:0/3619755064 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc140104920 msgr2=0x7fc140104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.463 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 --2- 10.20.193.98:0/3619755064 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc140104920 0x7fc140104d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc1340099b0 tx=0x7fc13402f220 comp rx=0 tx=0).stop 2026-02-20T02:27:21.463 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 -- 10.20.193.98:0/3619755064 shutdown_connections 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 --2- 10.20.193.98:0/3619755064 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc140104920 0x7fc140104d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 --2- 10.20.193.98:0/3619755064 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc14010a920 0x7fc14010ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 -- 10.20.193.98:0/3619755064 >> 10.20.193.98:0/3619755064 conn(0x7fc140100620 msgr2=0x7fc140102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 -- 10.20.193.98:0/3619755064 shutdown_connections 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 -- 10.20.193.98:0/3619755064 wait complete. 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 Processor -- start 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 -- start start 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc140104920 0x7fc1401a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc14010a920 0x7fc1401a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc140111b40 con 0x7fc14010a920 2026-02-20T02:27:21.464 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.460+0000 7fc147b47640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc1401119c0 con 0x7fc140104920 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc1450bb640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc14010a920 0x7fc1401a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc1450bb640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc14010a920 0x7fc1401a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60638/0 (socket says 10.20.193.98:60638) 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc1450bb640 1 -- 10.20.193.98:0/1862278894 learned_addr learned my addr 10.20.193.98:0/1862278894 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc1458bc640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc140104920 0x7fc1401a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc1450bb640 1 -- 10.20.193.98:0/1862278894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc140104920 msgr2=0x7fc1401a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc1450bb640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc140104920 0x7fc1401a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc1450bb640 1 -- 10.20.193.98:0/1862278894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14019c6f0 con 0x7fc14010a920 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc1450bb640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc14010a920 0x7fc1401a2b60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc134009980 tx=0x7fc13402fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc12effd640 1 -- 10.20.193.98:0/1862278894 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc134004420 con 0x7fc14010a920 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc12effd640 1 -- 10.20.193.98:0/1862278894 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc134038a40 con 0x7fc14010a920 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14019c980 con 0x7fc14010a920 2026-02-20T02:27:21.465 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc12effd640 1 -- 10.20.193.98:0/1862278894 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc1340417e0 con 0x7fc14010a920 2026-02-20T02:27:21.466 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14019ce80 con 0x7fc14010a920 2026-02-20T02:27:21.466 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.461+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc140106060 con 0x7fc14010a920 2026-02-20T02:27:21.467 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.462+0000 7fc12effd640 1 -- 10.20.193.98:0/1862278894 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fc134038bf0 con 0x7fc14010a920 2026-02-20T02:27:21.467 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.463+0000 7fc12effd640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc11c0775a0 0x7fc11c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.467 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.463+0000 7fc1458bc640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc11c0775a0 0x7fc11c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.467 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.463+0000 7fc12effd640 1 -- 10.20.193.98:0/1862278894 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7134+0+0 (secure 0 0 0) 0x7fc13403e070 con 0x7fc14010a920 2026-02-20T02:27:21.467 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.463+0000 7fc1458bc640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc11c0775a0 0x7fc11c079a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc130002930 tx=0x7fc130005f50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:21.467 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.464+0000 7fc12effd640 1 -- 10.20.193.98:0/1862278894 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc13408b7b0 con 0x7fc14010a920 2026-02-20T02:27:21.571 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.570+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc14019d130 con 0x7fc14010a920 2026-02-20T02:27:21.572 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.570+0000 7fc12effd640 1 -- 10.20.193.98:0/1862278894 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4917 (secure 0 0 0) 0x7fc134090660 con 0x7fc14010a920 2026-02-20T02:27:21.572 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:21.572 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":7,"btime":"2026-02-20T02:27:21:532026+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T02:27:17.873288+0000","modified":"2026-02-20T02:27:20.525848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24325":{"gid":24325,"name":"foo.trial106.alrimh","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"10.20.193.106:6833/3928932355","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6832","nonce":3928932355},{"type":"v1","addr":"10.20.193.106:6833","nonce":3928932355}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24325,"qdb_cluster":[24325]},"id":1},{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T02:27:19.880373+0000","modified":"2026-02-20T02:27:21.532025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14560":{"gid":14560,"name":"bar.trial098.pnrgwl","rank":0,"incarnation":7,"state":"up:replay","state_seq":1,"addr":"10.20.193.98:6837/3550319586","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6836","nonce":3550319586},{"type":"v1","addr":"10.20.193.98:6837","nonce":3550319586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2026-02-20T02:27:21.573 INFO:teuthology.orchestra.run.trial098.stderr:dumped fsmap epoch 7 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc11c0775a0 msgr2=0x7fc11c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc11c0775a0 0x7fc11c079a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc130002930 tx=0x7fc130005f50 comp rx=0 tx=0).stop 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc14010a920 msgr2=0x7fc1401a2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc14010a920 0x7fc1401a2b60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc134009980 tx=0x7fc13402fdf0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 shutdown_connections 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc11c0775a0 0x7fc11c079a60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc14010a920 0x7fc1401a2b60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 --2- 10.20.193.98:0/1862278894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc140104920 0x7fc1401a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 >> 10.20.193.98:0/1862278894 conn(0x7fc140100620 msgr2=0x7fc140101780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:21.574 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 shutdown_connections 2026-02-20T02:27:21.575 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.572+0000 7fc147b47640 1 -- 10.20.193.98:0/1862278894 wait complete. 2026-02-20T02:27:21.629 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T02:27:21.788 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:21.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 -- 10.20.193.98:0/679195990 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 msgr2=0x7fc810104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 --2- 10.20.193.98:0/679195990 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 0x7fc810104d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80099b0 tx=0x7fc7f802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:21.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 -- 10.20.193.98:0/679195990 shutdown_connections 2026-02-20T02:27:21.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 --2- 10.20.193.98:0/679195990 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 0x7fc810104d80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 --2- 10.20.193.98:0/679195990 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc81010a920 0x7fc81010ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 -- 10.20.193.98:0/679195990 >> 10.20.193.98:0/679195990 conn(0x7fc810100620 msgr2=0x7fc810102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:21.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 -- 10.20.193.98:0/679195990 shutdown_connections 2026-02-20T02:27:21.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 -- 10.20.193.98:0/679195990 wait complete. 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 Processor -- start 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.895+0000 7fc81599b640 1 -- start start 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc81599b640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 0x7fc8101a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc81599b640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc81010a920 0x7fc8101a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc81599b640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc810111b40 con 0x7fc810104920 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc81599b640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc8101119c0 con 0x7fc81010a920 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 0x7fc8101a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80effd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 0x7fc8101a2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60682/0 (socket says 10.20.193.98:60682) 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80effd640 1 -- 10.20.193.98:0/2221905510 learned_addr learned my addr 10.20.193.98:0/2221905510 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80e7fc640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc81010a920 0x7fc8101a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80effd640 1 -- 10.20.193.98:0/2221905510 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc81010a920 msgr2=0x7fc8101a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80effd640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc81010a920 0x7fc8101a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80effd640 1 -- 10.20.193.98:0/2221905510 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81019c6f0 con 0x7fc810104920 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80e7fc640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc81010a920 0x7fc8101a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc80effd640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 0x7fc8101a2620 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c910 tx=0x7fc80400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc814999640 1 -- 10.20.193.98:0/2221905510 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc804007c30 con 0x7fc810104920 2026-02-20T02:27:21.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81019c9e0 con 0x7fc810104920 2026-02-20T02:27:21.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc814999640 1 -- 10.20.193.98:0/2221905510 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc804007dd0 con 0x7fc810104920 2026-02-20T02:27:21.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc814999640 1 -- 10.20.193.98:0/2221905510 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc80400f450 con 0x7fc810104920 2026-02-20T02:27:21.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.896+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81019cf40 con 0x7fc810104920 2026-02-20T02:27:21.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.897+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc810106060 con 0x7fc810104920 2026-02-20T02:27:21.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.897+0000 7fc814999640 1 -- 10.20.193.98:0/2221905510 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fc804005000 con 0x7fc810104920 2026-02-20T02:27:21.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.898+0000 7fc814999640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc7e40775a0 0x7fc7e4079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:21.899 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.898+0000 7fc814999640 1 -- 10.20.193.98:0/2221905510 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7fc80409a2d0 con 0x7fc810104920 2026-02-20T02:27:21.899 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.898+0000 7fc80e7fc640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc7e40775a0 0x7fc7e4079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:21.899 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.898+0000 7fc80e7fc640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc7e40775a0 0x7fc7e4079a60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8004870 tx=0x7fc7f80047e0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:21.900 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.900+0000 7fc814999640 1 -- 10.20.193.98:0/2221905510 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc804014030 con 0x7fc810104920 2026-02-20T02:27:21.986 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.985+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc810104d80 con 0x7fc810104920 2026-02-20T02:27:21.987 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.986+0000 7fc814999640 1 -- 10.20.193.98:0/2221905510 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+21469 (secure 0 0 0) 0x7fc804066de0 con 0x7fc810104920 2026-02-20T02:27:21.987 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:21.988 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":58,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","created":"2026-02-20T02:24:56.142342+0000","modified":"2026-02-20T02:27:21.531935+0000","last_up_change":"2026-02-20T02:27:06.838718+0000","last_in_change":"2026-02-20T02:26:54.128339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T02:26:21.525878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2026-02-20T02:27:16.030517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2026-02-20T02:27:16.871831+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2026-02-20T02:27:18.281459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2026-02-20T02:27:18.883418+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69983772-bfd2-47c6-858b-c78a6ba6bbdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6802","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6803","nonce":3443765866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6804","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6805","nonce":3443765866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6808","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6809","nonce":3443765866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6806","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6807","nonce":3443765866}]},"public_addr":"10.20.193.98:6803/3443765866","cluster_addr":"10.20.193.98:6805/3443765866","heartbeat_back_addr":"10.20.193.98:6809/3443765866","heartbeat_front_addr":"10.20.193.98:6807/3443765866","state":["exists","up"]},{"osd":1,"uuid":"b4cad49e-fbde-4300-ba11-a955ab405675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6810","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6811","nonce":1242417476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6812","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6813","nonce":1242417476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6816","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6817","nonce":1242417476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6814","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6815","nonce":1242417476}]},"public_addr":"10.20.193.98:6811/1242417476","cluster_addr":"10.20.193.98:6813/1242417476","heartbeat_back_addr":"10.20.193.98:6817/1242417476","heartbeat_front_addr":"10.20.193.98:6815/1242417476","state":["exists","up"]},{"osd":2,"uuid":"7ec05305-8212-4015-b82a-66a1c330bff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6818","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6819","nonce":3521404611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6820","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6821","nonce":3521404611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6824","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6825","nonce":3521404611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6822","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6823","nonce":3521404611}]},"public_addr":"10.20.193.98:6819/3521404611","cluster_addr":"10.20.193.98:6821/3521404611","heartbeat_back_addr":"10.20.193.98:6825/3521404611","heartbeat_front_addr":"10.20.193.98:6823/3521404611","state":["exists","up"]},{"osd":3,"uuid":"62e618a0-0ca1-40e0-8beb-24b9d89ecfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6826","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6827","nonce":3887278641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6828","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6829","nonce":3887278641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6832","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6833","nonce":3887278641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6830","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6831","nonce":3887278641}]},"public_addr":"10.20.193.98:6827/3887278641","cluster_addr":"10.20.193.98:6829/3887278641","heartbeat_back_addr":"10.20.193.98:6833/3887278641","heartbeat_front_addr":"10.20.193.98:6831/3887278641","state":["exists","up"]},{"osd":4,"uuid":"35dfa3a0-e20f-407f-a124-753ef1241351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6800","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6801","nonce":458320702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6803","nonce":458320702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6807","nonce":458320702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6805","nonce":458320702}]},"public_addr":"10.20.193.106:6801/458320702","cluster_addr":"10.20.193.106:6803/458320702","heartbeat_back_addr":"10.20.193.106:6807/458320702","heartbeat_front_addr":"10.20.193.106:6805/458320702","state":["exists","up"]},{"osd":5,"uuid":"646d457d-9777-4425-a4c6-edb74643b7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6809","nonce":1544178256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6810","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6811","nonce":1544178256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6814","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6815","nonce":1544178256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6812","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6813","nonce":1544178256}]},"public_addr":"10.20.193.106:6809/1544178256","cluster_addr":"10.20.193.106:6811/1544178256","heartbeat_back_addr":"10.20.193.106:6815/1544178256","heartbeat_front_addr":"10.20.193.106:6813/1544178256","state":["exists","up"]},{"osd":6,"uuid":"8dbfc155-0624-4bb5-9a00-04227cdb859a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6816","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6817","nonce":3694375899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6818","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6819","nonce":3694375899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6822","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6823","nonce":3694375899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6820","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6821","nonce":3694375899}]},"public_addr":"10.20.193.106:6817/3694375899","cluster_addr":"10.20.193.106:6819/3694375899","heartbeat_back_addr":"10.20.193.106:6823/3694375899","heartbeat_front_addr":"10.20.193.106:6821/3694375899","state":["exists","up"]},{"osd":7,"uuid":"0d9b95d9-47be-4fb9-9796-8f9f75d14e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6824","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6825","nonce":3281087512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6826","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6827","nonce":3281087512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6830","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6831","nonce":3281087512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6828","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6829","nonce":3281087512}]},"public_addr":"10.20.193.106:6825/3281087512","cluster_addr":"10.20.193.106:6827/3281087512","heartbeat_back_addr":"10.20.193.106:6831/3281087512","heartbeat_front_addr":"10.20.193.106:6829/3281087512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:02.738489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:10.724666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:19.868177+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:29.070816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:37.618888+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:47.625118+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:56.407926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:27:05.568619+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.98:0/2186036449":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6801/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/4072581924":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6834/390933865":"2026-02-21T02:27:21.531921+0000","10.20.193.98:0/757881106":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6800/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/180891152":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6835/390933865":"2026-02-21T02:27:21.531921+0000","10.20.193.98:0/494053877":"2026-02-21T02:25:05.975323+0000","10.20.193.98:0/635628968":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/433631514":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/3304232391":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6800/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:6800/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/3223427167":"2026-02-21T02:25:15.462934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T02:27:21.989 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc7e40775a0 msgr2=0x7fc7e4079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.989 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc7e40775a0 0x7fc7e4079a60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8004870 tx=0x7fc7f80047e0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.989 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 msgr2=0x7fc8101a2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:21.990 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 0x7fc8101a2620 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c910 tx=0x7fc80400cde0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.990 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 shutdown_connections 2026-02-20T02:27:21.990 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fc7e40775a0 0x7fc7e4079a60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.990 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fc81010a920 0x7fc8101a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.990 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 --2- 10.20.193.98:0/2221905510 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fc810104920 0x7fc8101a2620 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:21.990 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 >> 10.20.193.98:0/2221905510 conn(0x7fc810100620 msgr2=0x7fc810101780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:21.990 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 shutdown_connections 2026-02-20T02:27:21.990 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:21.987+0000 7fc81599b640 1 -- 10.20.193.98:0/2221905510 wait complete. 2026-02-20T02:27:22.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-20T02:27:17.873288+0000', 'modified': '2026-02-20T02:27:20.525848+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24325}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24325': {'gid': 24325, 'name': 'foo.trial106.alrimh', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '10.20.193.106:6833/3928932355', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.106:6832', 'nonce': 3928932355}, {'type': 'v1', 'addr': '10.20.193.106:6833', 'nonce': 3928932355}]}, 'join_fscid': 1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'foo', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24325, 'qdb_cluster': [24325]} 2026-02-20T02:27:22.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-20T02:27:22.027 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell mds.foo.trial106.alrimh status 2026-02-20T02:27:22.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: osdmap e57: 8 total, 8 up, 8 in 2026-02-20T02:27:22.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/388076077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T02:27:22.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:22.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:22.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:22.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.trial106.thijxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T02:27:22.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial106.thijxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: Deploying daemon mds.bar.trial106.thijxu on trial106 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: pgmap v99: 129 pgs: 48 active+clean, 32 creating+peering, 49 unknown; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 3.0 KiB/s wr, 7 op/s 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.98:6834/390933865,v1:10.20.193.98:6835/390933865] up:active 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] up:boot 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: Dropping low affinity active daemon mds.foo.trial098.qfxvya in favor of higher affinity standby. 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: Replacing daemon mds.foo.trial098.qfxvya as rank 0 with standby daemon mds.bar.trial098.pnrgwl 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: fsmap foo:1 bar:1 {bar:0=foo.trial098.qfxvya=up:active,foo:0=foo.trial106.alrimh=up:active} 1 up:standby 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "bar.trial098.pnrgwl"}]: dispatch 2026-02-20T02:27:22.119 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: osdmap e58: 8 total, 8 up, 8 in 2026-02-20T02:27:22.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: fsmap foo:1 bar:1/1 {bar:0=bar.trial098.pnrgwl=up:replay,foo:0=foo.trial106.alrimh=up:active} 2026-02-20T02:27:22.120 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:21 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1862278894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T02:27:22.192 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:22.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: osdmap e57: 8 total, 8 up, 8 in 2026-02-20T02:27:22.215 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/388076077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T02:27:22.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:22.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:22.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:22.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.trial106.thijxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T02:27:22.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial106.thijxu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T02:27:22.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:22.216 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: Deploying daemon mds.bar.trial106.thijxu on trial106 2026-02-20T02:27:22.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: pgmap v99: 129 pgs: 48 active+clean, 32 creating+peering, 49 unknown; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 3.0 KiB/s wr, 7 op/s 2026-02-20T02:27:22.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.98:6834/390933865,v1:10.20.193.98:6835/390933865] up:active 2026-02-20T02:27:22.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] up:boot 2026-02-20T02:27:22.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: Dropping low affinity active daemon mds.foo.trial098.qfxvya in favor of higher affinity standby. 2026-02-20T02:27:22.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: Replacing daemon mds.foo.trial098.qfxvya as rank 0 with standby daemon mds.bar.trial098.pnrgwl 2026-02-20T02:27:22.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-20T02:27:22.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2026-02-20T02:27:22.217 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: fsmap foo:1 bar:1 {bar:0=foo.trial098.qfxvya=up:active,foo:0=foo.trial106.alrimh=up:active} 1 up:standby 2026-02-20T02:27:22.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "bar.trial098.pnrgwl"}]: dispatch 2026-02-20T02:27:22.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: osdmap e58: 8 total, 8 up, 8 in 2026-02-20T02:27:22.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: fsmap foo:1 bar:1/1 {bar:0=bar.trial098.pnrgwl=up:replay,foo:0=foo.trial106.alrimh=up:active} 2026-02-20T02:27:22.218 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:21 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1862278894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 -- 10.20.193.98:0/251565071 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c10a8a0 msgr2=0x7f199c10ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 --2- 10.20.193.98:0/251565071 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c10a8a0 0x7f199c10ac80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f198c0099b0 tx=0x7f198c02f220 comp rx=0 tx=0).stop 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 -- 10.20.193.98:0/251565071 shutdown_connections 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 --2- 10.20.193.98:0/251565071 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f199c1048a0 0x7f199c104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 --2- 10.20.193.98:0/251565071 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c10a8a0 0x7f199c10ac80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 -- 10.20.193.98:0/251565071 >> 10.20.193.98:0/251565071 conn(0x7f199c100620 msgr2=0x7f199c102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 -- 10.20.193.98:0/251565071 shutdown_connections 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 -- 10.20.193.98:0/251565071 wait complete. 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 Processor -- start 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 -- start start 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c1048a0 0x7f199c1a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f199c10a8a0 0x7f199c1a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f199c111ac0 con 0x7f199c1048a0 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a3d3d640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f199c111940 con 0x7f199c10a8a0 2026-02-20T02:27:22.310 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a1ab2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c1048a0 0x7f199c1a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a1ab2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c1048a0 0x7f199c1a25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60700/0 (socket says 10.20.193.98:60700) 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a1ab2640 1 -- 10.20.193.98:0/3753682886 learned_addr learned my addr 10.20.193.98:0/3753682886 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.308+0000 7f19a12b1640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f199c10a8a0 0x7f199c1a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f19a1ab2640 1 -- 10.20.193.98:0/3753682886 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f199c10a8a0 msgr2=0x7f199c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f199c10a8a0 0x7f199c1a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f19a1ab2640 1 -- 10.20.193.98:0/3753682886 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c19c690 con 0x7f199c1048a0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c1048a0 0x7f199c1a25c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f198c009980 tx=0x7f198c02fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f198affd640 1 -- 10.20.193.98:0/3753682886 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f198c004420 con 0x7f199c1048a0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f198affd640 1 -- 10.20.193.98:0/3753682886 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f198c038a40 con 0x7f199c1048a0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f19a3d3d640 1 -- 10.20.193.98:0/3753682886 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199c19c920 con 0x7f199c1048a0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f198affd640 1 -- 10.20.193.98:0/3753682886 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f198c0417e0 con 0x7f199c1048a0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.309+0000 7f19a3d3d640 1 -- 10.20.193.98:0/3753682886 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199c19ce20 con 0x7f199c1048a0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.310+0000 7f198affd640 1 -- 10.20.193.98:0/3753682886 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f198c038bf0 con 0x7f199c1048a0 2026-02-20T02:27:22.311 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f198affd640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19780775a0 0x7f1978079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.312 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a12b1640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19780775a0 0x7f1978079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.312 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f198affd640 1 -- 10.20.193.98:0/3753682886 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f198c03e070 con 0x7f199c1048a0 2026-02-20T02:27:22.312 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a12b1640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19780775a0 0x7f1978079a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f199c19dee0 tx=0x7f1990005f50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:22.312 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a6242e00 1 Processor -- start 2026-02-20T02:27:22.312 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a6242e00 1 -- start start 2026-02-20T02:27:22.312 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a6242e00 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b2537460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.312 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a6242e00 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2535e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.312 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a6242e00 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x5633b24b3120 con 0x5633b25379a0 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a6242e00 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x5633b2485a40 con 0x5633b2537080 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a12b1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2535e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a12b1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2535e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60706/0 (socket says 10.20.193.98:60706) 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a12b1640 1 -- 10.20.193.98:0/1918921392 learned_addr learned my addr 10.20.193.98:0/1918921392 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/1918921392 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b2537460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a12b1640 1 -- 10.20.193.98:0/1918921392 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 msgr2=0x5633b2537460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a12b1640 1 --2- 10.20.193.98:0/1918921392 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b2537460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.311+0000 7f19a12b1640 1 -- 10.20.193.98:0/1918921392 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b243b4b0 con 0x5633b25379a0 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a12b1640 1 --2- 10.20.193.98:0/1918921392 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2535e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f199000fd00 tx=0x7f1990012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20736a81f0ddb284 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f196a4e6640 1 -- 10.20.193.98:0/1918921392 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1990011d60 con 0x5633b25379a0 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f196a4e6640 1 -- 10.20.193.98:0/1918921392 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1990023070 con 0x5633b25379a0 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f196a4e6640 1 -- 10.20.193.98:0/1918921392 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f19900105d0 con 0x5633b25379a0 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a6242e00 1 -- 10.20.193.98:0/1918921392 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 msgr2=0x5633b2535e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a6242e00 1 --2- 10.20.193.98:0/1918921392 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2535e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f199000fd00 tx=0x7f1990012000 comp rx=0 tx=0).stop 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a6242e00 1 -- 10.20.193.98:0/1918921392 shutdown_connections 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a6242e00 1 --2- 10.20.193.98:0/1918921392 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2535e20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.313 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a6242e00 1 --2- 10.20.193.98:0/1918921392 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b2537460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a6242e00 1 -- 10.20.193.98:0/1918921392 >> 10.20.193.98:0/1918921392 conn(0x5633b25296d0 msgr2=0x5633b2530550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a6242e00 1 -- 10.20.193.98:0/1918921392 shutdown_connections 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.312+0000 7f19a6242e00 1 -- 10.20.193.98:0/1918921392 wait complete. 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a6242e00 1 -- start start 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a6242e00 1 Processor -- start 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a6242e00 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b254bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a6242e00 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b254c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a6242e00 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x5633b2433250 con 0x5633b25379a0 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a6242e00 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x5633b242d030 con 0x5633b2537080 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a12b1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b254c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a12b1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b254c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60710/0 (socket says 10.20.193.98:60710) 2026-02-20T02:27:22.314 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a12b1640 1 -- 10.20.193.98:0/2486552019 learned_addr learned my addr 10.20.193.98:0/2486552019 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:22.315 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b254bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.315 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a12b1640 1 -- 10.20.193.98:0/2486552019 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 msgr2=0x5633b254bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T02:27:22.315 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a12b1640 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b254bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.315 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a12b1640 1 -- 10.20.193.98:0/2486552019 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b25438f0 con 0x5633b25379a0 2026-02-20T02:27:22.315 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19a12b1640 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b254c170 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1990004190 tx=0x7f199000fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af08531b5af1d92e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:22.315 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.313+0000 7f19577fe640 10 client.0 ms_handle_connect on v2:10.20.193.98:3300/0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19577fe640 1 -- 10.20.193.98:0/2486552019 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f199001e830 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19577fe640 1 -- 10.20.193.98:0/2486552019 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1990034440 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19577fe640 1 -- 10.20.193.98:0/2486552019 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f199002a640 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b2256950 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19577fe640 1 -- 10.20.193.98:0/2486552019 <== mon.0 v2:10.20.193.98:3300/0 4 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f1990017040 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19577fe640 10 client.14582 inactive, discarding osd_map(58..58 src has 1..58) 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 10 client.14582 _ll_register_callbacks cb 0x5633b2426a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5633b248d630 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19577fe640 1 -- 10.20.193.98:0/2486552019 <== mon.0 v2:10.20.193.98:3300/0 5 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f199001e9d0 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 10 client.14582 fetch_fsmap learned FSMap version 7 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({fsmap=7}) -- 0x5633b24403a0 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19577fe640 1 -- 10.20.193.98:0/2486552019 <== mon.0 v2:10.20.193.98:3300/0 6 ==== fsmap(e 7) ==== 2958+0+0 (secure 0 0 0) 0x7f1990032020 con 0x5633b25379a0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 10 client.14582 fetch_fsmap finished waiting for FSMap version 7 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 10 client.14582 resolve_mds: resolved name 'foo.trial106.alrimh' to daemon mds.foo.trial106.alrimh 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 20 client.14582 populate_metadata read hostname 'trial098' 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] conn(0x5633b2558320 0x5633b255a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 4 client.14582 mds_command: new command op to 24325 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 --> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633b2407bd0 con 0x5633b2558320 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.314+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] conn(0x5633b2558320 0x5633b255a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.315+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] conn(0x5633b2558320 0x5633b255a710 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa217bb97027fb server_cookie=146f4bb65bea9cde in_seq=0 out_seq=0 2026-02-20T02:27:22.316 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.315+0000 7f19577fe640 10 client.14582 ms_handle_connect on v2:10.20.193.106:6832/3928932355 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19577fe640 1 -- 10.20.193.98:0/2486552019 <== mds.0 v2:10.20.193.106:6832/3928932355 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5633b2407bd0 con 0x5633b2558320 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19577fe640 10 client.14582 handle_command_reply: tid=0 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 client.14582 shutdown 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 msgr2=0x5633b254c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b254c170 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1990004190 tx=0x7f199000fe70 comp rx=0 tx=0).stop 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 shutdown_connections 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] conn(0x5633b2558320 0x5633b255a710 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b254c170 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 --2- 10.20.193.98:0/2486552019 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b254bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19577fe640 0 client.14582 ms_handle_reset on v2:10.20.193.106:6832/3928932355 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 >> 10.20.193.98:0/2486552019 conn(0x5633b25296d0 msgr2=0x5633b2532c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 shutdown_connections 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 1 -- 10.20.193.98:0/2486552019 wait complete. 2026-02-20T02:27:22.317 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.316+0000 7f19a6242e00 20 client.14582 trim_cache size 0 max 16384 2026-02-20T02:27:22.331 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a6242e00 1 Processor -- start 2026-02-20T02:27:22.331 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a6242e00 1 -- start start 2026-02-20T02:27:22.331 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a6242e00 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b2537080 0x5633b2530e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a6242e00 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b25379a0 0x5633b25492a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a6242e00 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x5633b254b3e0 con 0x5633b2537080 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a6242e00 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f194800caf0 con 0x5633b25379a0 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a1ab2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b2537080 0x5633b2530e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a1ab2640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b2537080 0x5633b2530e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60714/0 (socket says 10.20.193.98:60714) 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a1ab2640 1 -- 10.20.193.98:0/2538257237 learned_addr learned my addr 10.20.193.98:0/2538257237 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a1ab2640 1 -- 10.20.193.98:0/2538257237 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b25379a0 msgr2=0x5633b25492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/2538257237 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b25379a0 0x5633b25492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.325+0000 7f19a1ab2640 1 -- 10.20.193.98:0/2538257237 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b25314f0 con 0x5633b2537080 2026-02-20T02:27:22.332 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/2538257237 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b2537080 0x5633b2530e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f198c082f70 tx=0x7f198c08a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c624ca1d9a12e0c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f1969ce5640 1 -- 10.20.193.98:0/2538257237 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f198c083180 con 0x5633b2537080 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f1969ce5640 1 -- 10.20.193.98:0/2538257237 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f198c033040 con 0x5633b2537080 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f1969ce5640 1 -- 10.20.193.98:0/2538257237 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f198c086150 con 0x5633b2537080 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a6242e00 1 -- 10.20.193.98:0/2538257237 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b2537080 msgr2=0x5633b2530e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a6242e00 1 --2- 10.20.193.98:0/2538257237 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b2537080 0x5633b2530e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f198c082f70 tx=0x7f198c08a040 comp rx=0 tx=0).stop 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a6242e00 1 -- 10.20.193.98:0/2538257237 shutdown_connections 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a6242e00 1 --2- 10.20.193.98:0/2538257237 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b25379a0 0x5633b25492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a6242e00 1 --2- 10.20.193.98:0/2538257237 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b2537080 0x5633b2530e90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a6242e00 1 -- 10.20.193.98:0/2538257237 >> 10.20.193.98:0/2538257237 conn(0x5633b25296d0 msgr2=0x5633b2548b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a6242e00 1 -- 10.20.193.98:0/2538257237 shutdown_connections 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.326+0000 7f19a6242e00 1 -- 10.20.193.98:0/2538257237 wait complete. 2026-02-20T02:27:22.333 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 1 -- start start 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 1 Processor -- start 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b2551560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2551aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x5633b2556be0 con 0x5633b25379a0 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f194800dad0 con 0x5633b2537080 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a12b1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2551aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a12b1640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2551aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60718/0 (socket says 10.20.193.98:60718) 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a12b1640 1 -- 10.20.193.98:0/665711238 learned_addr learned my addr 10.20.193.98:0/665711238 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a12b1640 1 -- 10.20.193.98:0/665711238 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 msgr2=0x5633b2551560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a12b1640 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b2551560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a12b1640 1 -- 10.20.193.98:0/665711238 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b2543720 con 0x5633b25379a0 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a12b1640 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2551aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f199000ff90 tx=0x7f199000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2edf22a1bedb76 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:22.334 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19577fe640 10 client.0 ms_handle_connect on v2:10.20.193.98:3300/0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19577fe640 1 -- 10.20.193.98:0/665711238 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f199001e830 con 0x5633b25379a0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19577fe640 1 -- 10.20.193.98:0/665711238 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x5633b248d630 con 0x5633b25379a0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19577fe640 1 -- 10.20.193.98:0/665711238 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1990028630 con 0x5633b25379a0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b2164680 con 0x5633b25379a0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19577fe640 1 -- 10.20.193.98:0/665711238 <== mon.0 v2:10.20.193.98:3300/0 4 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f19900287d0 con 0x5633b25379a0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19577fe640 10 client.14586 inactive, discarding osd_map(58..58 src has 1..58) 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 10 client.14586 _ll_register_callbacks cb 0x7f199000fc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.327+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1990023070 con 0x5633b25379a0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19577fe640 1 -- 10.20.193.98:0/665711238 <== mon.0 v2:10.20.193.98:3300/0 5 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f199004b060 con 0x5633b25379a0 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a6242e00 10 client.14586 fetch_fsmap learned FSMap version 7 2026-02-20T02:27:22.335 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({fsmap=7}) -- 0x5633b2425450 con 0x5633b25379a0 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19577fe640 1 -- 10.20.193.98:0/665711238 <== mon.0 v2:10.20.193.98:3300/0 6 ==== fsmap(e 7) ==== 2958+0+0 (secure 0 0 0) 0x7f1990032030 con 0x5633b25379a0 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a6242e00 10 client.14586 fetch_fsmap finished waiting for FSMap version 7 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a6242e00 10 client.14586 resolve_mds: resolved name 'foo.trial106.alrimh' to daemon mds.foo.trial106.alrimh 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a6242e00 20 client.14586 populate_metadata read hostname 'trial098' 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a6242e00 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] conn(0x5633b25c4df0 0x5633b25c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a6242e00 4 client.14586 mds_command: new command op to 24325 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 --> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] -- command(tid 0: {"prefix": "status"}) -- 0x5633b21f57a0 con 0x5633b25c4df0 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] conn(0x5633b25c4df0 0x5633b25c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19577fe640 10 client.14586 ms_handle_connect on v2:10.20.193.106:6832/3928932355 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.328+0000 7f19a1ab2640 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] conn(0x5633b25c4df0 0x5633b25c71e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=715ff1005e10a82f server_cookie=e877ed979142f4e2 in_seq=0 out_seq=0 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19577fe640 1 -- 10.20.193.98:0/665711238 <== mds.0 v2:10.20.193.106:6832/3928932355 1 ==== command_reply(tid 0: 0 ) ==== 8+0+313 (crc 0 0 0) 0x5633b21f57a0 con 0x5633b25c4df0 2026-02-20T02:27:22.336 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19577fe640 10 client.14586 handle_command_reply: tid=0 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 client.14586 shutdown 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 msgr2=0x5633b2551aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2551aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f199000ff90 tx=0x7f199000f9f0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 shutdown_connections 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.106:6832/3928932355,v1:10.20.193.106:6833/3928932355] conn(0x5633b25c4df0 0x5633b25c71e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x5633b25379a0 0x5633b2551aa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19577fe640 0 client.14586 ms_handle_reset on v2:10.20.193.106:6832/3928932355 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 --2- 10.20.193.98:0/665711238 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x5633b2537080 0x5633b2551560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 >> 10.20.193.98:0/665711238 conn(0x5633b25296d0 msgr2=0x5633b25493b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 shutdown_connections 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 1 -- 10.20.193.98:0/665711238 wait complete. 2026-02-20T02:27:22.337 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a6242e00 20 client.14586 trim_cache size 0 max 16384 2026-02-20T02:27:22.338 INFO:teuthology.orchestra.run.trial098.stdout:{ 2026-02-20T02:27:22.338 INFO:teuthology.orchestra.run.trial098.stdout: "cluster_fsid": "5138774d-0e03-11f1-8edf-d404e6e7d460", 2026-02-20T02:27:22.338 INFO:teuthology.orchestra.run.trial098.stdout: "whoami": 0, 2026-02-20T02:27:22.338 INFO:teuthology.orchestra.run.trial098.stdout: "id": 24325, 2026-02-20T02:27:22.338 INFO:teuthology.orchestra.run.trial098.stdout: "want_state": "up:active", 2026-02-20T02:27:22.338 INFO:teuthology.orchestra.run.trial098.stdout: "state": "up:active", 2026-02-20T02:27:22.338 INFO:teuthology.orchestra.run.trial098.stdout: "fs_name": "foo", 2026-02-20T02:27:22.339 INFO:teuthology.orchestra.run.trial098.stdout: "rank_uptime": 2.802821217, 2026-02-20T02:27:22.339 INFO:teuthology.orchestra.run.trial098.stdout: "mdsmap_epoch": 5, 2026-02-20T02:27:22.339 INFO:teuthology.orchestra.run.trial098.stdout: "osdmap_epoch": 58, 2026-02-20T02:27:22.339 INFO:teuthology.orchestra.run.trial098.stdout: "osdmap_epoch_barrier": 56, 2026-02-20T02:27:22.339 INFO:teuthology.orchestra.run.trial098.stdout: "uptime": 3.06434432 2026-02-20T02:27:22.339 INFO:teuthology.orchestra.run.trial098.stdout:} 2026-02-20T02:27:22.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 -- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19780775a0 msgr2=0x7f1978079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19780775a0 0x7f1978079a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f199c19dee0 tx=0x7f1990005f50 comp rx=0 tx=0).stop 2026-02-20T02:27:22.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 -- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c1048a0 msgr2=0x7f199c1a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c1048a0 0x7f199c1a25c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f198c009980 tx=0x7f198c02fdf0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 -- 10.20.193.98:0/3753682886 shutdown_connections 2026-02-20T02:27:22.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f19780775a0 0x7f1978079a60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.340 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f199c10a8a0 0x7f199c1a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.341 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 --2- 10.20.193.98:0/3753682886 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f199c1048a0 0x7f199c1a25c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.341 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.329+0000 7f19a3d3d640 1 -- 10.20.193.98:0/3753682886 >> 10.20.193.98:0/3753682886 conn(0x7f199c100620 msgr2=0x7f199c1027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:22.341 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.330+0000 7f19a3d3d640 1 -- 10.20.193.98:0/3753682886 shutdown_connections 2026-02-20T02:27:22.341 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.330+0000 7f19a3d3d640 1 -- 10.20.193.98:0/3753682886 wait complete. 2026-02-20T02:27:22.366 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T02:27:22.534 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:22.653 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.649+0000 7fed57b12640 1 -- 10.20.193.98:0/3710470539 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50108640 msgr2=0x7fed50108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.653 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.649+0000 7fed57b12640 1 --2- 10.20.193.98:0/3710470539 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50108640 0x7fed50108a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed400099b0 tx=0x7fed4002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.650+0000 7fed57b12640 1 -- 10.20.193.98:0/3710470539 shutdown_connections 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.650+0000 7fed57b12640 1 --2- 10.20.193.98:0/3710470539 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fed50102640 0x7fed50102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.650+0000 7fed57b12640 1 --2- 10.20.193.98:0/3710470539 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50108640 0x7fed50108a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.650+0000 7fed57b12640 1 -- 10.20.193.98:0/3710470539 >> 10.20.193.98:0/3710470539 conn(0x7fed500fe360 msgr2=0x7fed50100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.650+0000 7fed57b12640 1 -- 10.20.193.98:0/3710470539 shutdown_connections 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.650+0000 7fed57b12640 1 -- 10.20.193.98:0/3710470539 wait complete. 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.650+0000 7fed57b12640 1 Processor -- start 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.650+0000 7fed57b12640 1 -- start start 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed57b12640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50102640 0x7fed5019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.654 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed57b12640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fed50108640 0x7fed5019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed57b12640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fed5010f8e0 con 0x7fed50102640 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed57b12640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fed5010f760 con 0x7fed50108640 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed55887640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50102640 0x7fed5019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed55887640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50102640 0x7fed5019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60746/0 (socket says 10.20.193.98:60746) 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed55887640 1 -- 10.20.193.98:0/2349029956 learned_addr learned my addr 10.20.193.98:0/2349029956 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed55887640 1 -- 10.20.193.98:0/2349029956 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fed50108640 msgr2=0x7fed5019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed55887640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fed50108640 0x7fed5019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed55887640 1 -- 10.20.193.98:0/2349029956 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5019ef50 con 0x7fed50102640 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed55887640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50102640 0x7fed5019a680 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed40009980 tx=0x7fed400029c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed3effd640 1 -- 10.20.193.98:0/2349029956 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fed40046070 con 0x7fed50102640 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5019f1e0 con 0x7fed50102640 2026-02-20T02:27:22.655 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed3effd640 1 -- 10.20.193.98:0/2349029956 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fed40038a40 con 0x7fed50102640 2026-02-20T02:27:22.656 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed3effd640 1 -- 10.20.193.98:0/2349029956 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fed400419a0 con 0x7fed50102640 2026-02-20T02:27:22.656 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.651+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5019f710 con 0x7fed50102640 2026-02-20T02:27:22.656 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.652+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed50103d80 con 0x7fed50102640 2026-02-20T02:27:22.657 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.652+0000 7fed3effd640 1 -- 10.20.193.98:0/2349029956 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fed40038bf0 con 0x7fed50102640 2026-02-20T02:27:22.657 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.653+0000 7fed3effd640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fed2c077550 0x7fed2c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:22.657 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.653+0000 7fed55086640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fed2c077550 0x7fed2c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:22.657 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.653+0000 7fed3effd640 1 -- 10.20.193.98:0/2349029956 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7fed4003e070 con 0x7fed50102640 2026-02-20T02:27:22.657 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.653+0000 7fed55086640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fed2c077550 0x7fed2c079a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed50100be0 tx=0x7fed44006d90 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:22.657 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.655+0000 7fed3effd640 1 -- 10.20.193.98:0/2349029956 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fed40050080 con 0x7fed50102640 2026-02-20T02:27:22.764 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.763+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed50102b20 con 0x7fed50102640 2026-02-20T02:27:22.765 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.763+0000 7fed3effd640 1 -- 10.20.193.98:0/2349029956 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6607 (secure 0 0 0) 0x7fed4008b830 con 0x7fed50102640 2026-02-20T02:27:22.765 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:22.765 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":8,"btime":"2026-02-20T02:27:22:532952+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"foo.trial098.qfxvya","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.98:6835/1231687035","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6834","nonce":1231687035},{"type":"v1","addr":"10.20.193.98:6835","nonce":1231687035}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24345,"name":"bar.trial106.thijxu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.106:6835/1482206819","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6834","nonce":1482206819},{"type":"v1","addr":"10.20.193.106:6835","nonce":1482206819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T02:27:17.873288+0000","modified":"2026-02-20T02:27:20.525848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24325":{"gid":24325,"name":"foo.trial106.alrimh","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"10.20.193.106:6833/3928932355","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6832","nonce":3928932355},{"type":"v1","addr":"10.20.193.106:6833","nonce":3928932355}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24325,"qdb_cluster":[24325]},"id":1},{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T02:27:19.880373+0000","modified":"2026-02-20T02:27:21.541807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14560":{"gid":14560,"name":"bar.trial098.pnrgwl","rank":0,"incarnation":7,"state":"up:reconnect","state_seq":2,"addr":"10.20.193.98:6837/3550319586","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6836","nonce":3550319586},{"type":"v1","addr":"10.20.193.98:6837","nonce":3550319586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2026-02-20T02:27:22.765 INFO:teuthology.orchestra.run.trial098.stderr:dumped fsmap epoch 8 2026-02-20T02:27:22.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fed2c077550 msgr2=0x7fed2c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fed2c077550 0x7fed2c079a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed50100be0 tx=0x7fed44006d90 comp rx=0 tx=0).stop 2026-02-20T02:27:22.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50102640 msgr2=0x7fed5019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:22.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50102640 0x7fed5019a680 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fed40009980 tx=0x7fed400029c0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.767 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 shutdown_connections 2026-02-20T02:27:22.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fed2c077550 0x7fed2c079a10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fed50108640 0x7fed5019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 --2- 10.20.193.98:0/2349029956 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fed50102640 0x7fed5019a680 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:22.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 >> 10.20.193.98:0/2349029956 conn(0x7fed500fe360 msgr2=0x7fed500ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:22.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 shutdown_connections 2026-02-20T02:27:22.768 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:22.765+0000 7fed57b12640 1 -- 10.20.193.98:0/2349029956 wait complete. 2026-02-20T02:27:22.804 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T02:27:22.964 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2221905510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] up:reconnect 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.98:6834/1231687035,v1:10.20.193.98:6835/1231687035] up:boot 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.106:6834/1482206819,v1:10.20.193.106:6835/1482206819] up:boot 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: fsmap foo:1 bar:1/1 {bar:0=bar.trial098.pnrgwl=up:reconnect,foo:0=foo.trial106.alrimh=up:active} 2 up:standby 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "foo.trial098.qfxvya"}]: dispatch 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "bar.trial106.thijxu"}]: dispatch 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.019 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:22 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2349029956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 -- 10.20.193.98:0/4028578708 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 msgr2=0x7f14a410ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 --2- 10.20.193.98:0/4028578708 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 0x7f14a410ad00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14900099b0 tx=0x7f149002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 -- 10.20.193.98:0/4028578708 shutdown_connections 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 --2- 10.20.193.98:0/4028578708 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f14a4104920 0x7f14a4104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 --2- 10.20.193.98:0/4028578708 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 0x7f14a410ad00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 -- 10.20.193.98:0/4028578708 >> 10.20.193.98:0/4028578708 conn(0x7f14a4100620 msgr2=0x7f14a4102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 -- 10.20.193.98:0/4028578708 shutdown_connections 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 -- 10.20.193.98:0/4028578708 wait complete. 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 Processor -- start 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.079+0000 7f14aa186640 1 -- start start 2026-02-20T02:27:23.081 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14aa186640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f14a4104920 0x7f14a41a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14aa186640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 0x7f14a41a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14aa186640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f14a4111b60 con 0x7f14a410a920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14aa186640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f14a41119e0 con 0x7f14a4104920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a2ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 0x7f14a41a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a2ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 0x7f14a41a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60770/0 (socket says 10.20.193.98:60770) 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a2ffd640 1 -- 10.20.193.98:0/718831802 learned_addr learned my addr 10.20.193.98:0/718831802 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a37fe640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f14a4104920 0x7f14a41a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a2ffd640 1 -- 10.20.193.98:0/718831802 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f14a4104920 msgr2=0x7f14a41a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a2ffd640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f14a4104920 0x7f14a41a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a2ffd640 1 -- 10.20.193.98:0/718831802 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a419c690 con 0x7f14a410a920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a37fe640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f14a4104920 0x7f14a41a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a2ffd640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 0x7f14a41a2b00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f149400c8f0 tx=0x7f149400cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a0ff9640 1 -- 10.20.193.98:0/718831802 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1494007c30 con 0x7f14a410a920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a419c980 con 0x7f14a410a920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a0ff9640 1 -- 10.20.193.98:0/718831802 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1494007dd0 con 0x7f14a410a920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14a0ff9640 1 -- 10.20.193.98:0/718831802 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f14940187c0 con 0x7f14a410a920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.080+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a419cee0 con 0x7f14a410a920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.081+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a4106060 con 0x7f14a410a920 2026-02-20T02:27:23.082 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.081+0000 7f14a0ff9640 1 -- 10.20.193.98:0/718831802 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f149400f450 con 0x7f14a410a920 2026-02-20T02:27:23.083 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.082+0000 7f14a0ff9640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f14780775a0 0x7f1478079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:23.083 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.082+0000 7f14a0ff9640 1 -- 10.20.193.98:0/718831802 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f149409a5e0 con 0x7f14a410a920 2026-02-20T02:27:23.083 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.082+0000 7f14a37fe640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f14780775a0 0x7f1478079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:23.083 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.082+0000 7f14a37fe640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f14780775a0 0x7f1478079a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f14900097c0 tx=0x7f149003a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:23.085 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.084+0000 7f14a0ff9640 1 -- 10.20.193.98:0/718831802 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1494014030 con 0x7f14a410a920 2026-02-20T02:27:23.169 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.168+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14a419d1f0 con 0x7f14a410a920 2026-02-20T02:27:23.170 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.169+0000 7f14a0ff9640 1 -- 10.20.193.98:0/718831802 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+21469 (secure 0 0 0) 0x7f149401f300 con 0x7f14a410a920 2026-02-20T02:27:23.170 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":58,"fsid":"5138774d-0e03-11f1-8edf-d404e6e7d460","created":"2026-02-20T02:24:56.142342+0000","modified":"2026-02-20T02:27:21.531935+0000","last_up_change":"2026-02-20T02:27:06.838718+0000","last_in_change":"2026-02-20T02:26:54.128339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T02:26:21.525878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2026-02-20T02:27:16.030517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2026-02-20T02:27:16.871831+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2026-02-20T02:27:18.281459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2026-02-20T02:27:18.883418+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69983772-bfd2-47c6-858b-c78a6ba6bbdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6802","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6803","nonce":3443765866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6804","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6805","nonce":3443765866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6808","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6809","nonce":3443765866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6806","nonce":3443765866},{"type":"v1","addr":"10.20.193.98:6807","nonce":3443765866}]},"public_addr":"10.20.193.98:6803/3443765866","cluster_addr":"10.20.193.98:6805/3443765866","heartbeat_back_addr":"10.20.193.98:6809/3443765866","heartbeat_front_addr":"10.20.193.98:6807/3443765866","state":["exists","up"]},{"osd":1,"uuid":"b4cad49e-fbde-4300-ba11-a955ab405675","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6810","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6811","nonce":1242417476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6812","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6813","nonce":1242417476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6816","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6817","nonce":1242417476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6814","nonce":1242417476},{"type":"v1","addr":"10.20.193.98:6815","nonce":1242417476}]},"public_addr":"10.20.193.98:6811/1242417476","cluster_addr":"10.20.193.98:6813/1242417476","heartbeat_back_addr":"10.20.193.98:6817/1242417476","heartbeat_front_addr":"10.20.193.98:6815/1242417476","state":["exists","up"]},{"osd":2,"uuid":"7ec05305-8212-4015-b82a-66a1c330bff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6818","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6819","nonce":3521404611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6820","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6821","nonce":3521404611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6824","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6825","nonce":3521404611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6822","nonce":3521404611},{"type":"v1","addr":"10.20.193.98:6823","nonce":3521404611}]},"public_addr":"10.20.193.98:6819/3521404611","cluster_addr":"10.20.193.98:6821/3521404611","heartbeat_back_addr":"10.20.193.98:6825/3521404611","heartbeat_front_addr":"10.20.193.98:6823/3521404611","state":["exists","up"]},{"osd":3,"uuid":"62e618a0-0ca1-40e0-8beb-24b9d89ecfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6826","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6827","nonce":3887278641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6828","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6829","nonce":3887278641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6832","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6833","nonce":3887278641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6830","nonce":3887278641},{"type":"v1","addr":"10.20.193.98:6831","nonce":3887278641}]},"public_addr":"10.20.193.98:6827/3887278641","cluster_addr":"10.20.193.98:6829/3887278641","heartbeat_back_addr":"10.20.193.98:6833/3887278641","heartbeat_front_addr":"10.20.193.98:6831/3887278641","state":["exists","up"]},{"osd":4,"uuid":"35dfa3a0-e20f-407f-a124-753ef1241351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6800","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6801","nonce":458320702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6802","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6803","nonce":458320702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6806","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6807","nonce":458320702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6804","nonce":458320702},{"type":"v1","addr":"10.20.193.106:6805","nonce":458320702}]},"public_addr":"10.20.193.106:6801/458320702","cluster_addr":"10.20.193.106:6803/458320702","heartbeat_back_addr":"10.20.193.106:6807/458320702","heartbeat_front_addr":"10.20.193.106:6805/458320702","state":["exists","up"]},{"osd":5,"uuid":"646d457d-9777-4425-a4c6-edb74643b7e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6808","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6809","nonce":1544178256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6810","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6811","nonce":1544178256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6814","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6815","nonce":1544178256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6812","nonce":1544178256},{"type":"v1","addr":"10.20.193.106:6813","nonce":1544178256}]},"public_addr":"10.20.193.106:6809/1544178256","cluster_addr":"10.20.193.106:6811/1544178256","heartbeat_back_addr":"10.20.193.106:6815/1544178256","heartbeat_front_addr":"10.20.193.106:6813/1544178256","state":["exists","up"]},{"osd":6,"uuid":"8dbfc155-0624-4bb5-9a00-04227cdb859a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6816","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6817","nonce":3694375899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6818","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6819","nonce":3694375899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6822","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6823","nonce":3694375899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6820","nonce":3694375899},{"type":"v1","addr":"10.20.193.106:6821","nonce":3694375899}]},"public_addr":"10.20.193.106:6817/3694375899","cluster_addr":"10.20.193.106:6819/3694375899","heartbeat_back_addr":"10.20.193.106:6823/3694375899","heartbeat_front_addr":"10.20.193.106:6821/3694375899","state":["exists","up"]},{"osd":7,"uuid":"0d9b95d9-47be-4fb9-9796-8f9f75d14e61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6824","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6825","nonce":3281087512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6826","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6827","nonce":3281087512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6830","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6831","nonce":3281087512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6828","nonce":3281087512},{"type":"v1","addr":"10.20.193.106:6829","nonce":3281087512}]},"public_addr":"10.20.193.106:6825/3281087512","cluster_addr":"10.20.193.106:6827/3281087512","heartbeat_back_addr":"10.20.193.106:6831/3281087512","heartbeat_front_addr":"10.20.193.106:6829/3281087512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:02.738489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:10.724666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:19.868177+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:29.070816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:37.618888+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:47.625118+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:26:56.407926+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T02:27:05.568619+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.98:0/2186036449":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6801/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/4072581924":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6834/390933865":"2026-02-21T02:27:21.531921+0000","10.20.193.98:0/757881106":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6800/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/802451532":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6801/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/180891152":"2026-02-21T02:25:33.491288+0000","10.20.193.98:6835/390933865":"2026-02-21T02:27:21.531921+0000","10.20.193.98:0/494053877":"2026-02-21T02:25:05.975323+0000","10.20.193.98:0/635628968":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/433631514":"2026-02-21T02:25:15.462934+0000","10.20.193.98:0/3304232391":"2026-02-21T02:25:05.975323+0000","10.20.193.98:6800/2682971939":"2026-02-21T02:25:15.462934+0000","10.20.193.98:6800/892283834":"2026-02-21T02:25:33.491288+0000","10.20.193.98:0/3223427167":"2026-02-21T02:25:15.462934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f14780775a0 msgr2=0x7f1478079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f14780775a0 0x7f1478079a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f14900097c0 tx=0x7f149003a040 comp rx=0 tx=0).stop 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 msgr2=0x7f14a41a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 0x7f14a41a2b00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f149400c8f0 tx=0x7f149400cdc0 comp rx=0 tx=0).stop 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 shutdown_connections 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f14780775a0 0x7f1478079a60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f14a410a920 0x7f14a41a2b00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 --2- 10.20.193.98:0/718831802 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f14a4104920 0x7f14a41a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 >> 10.20.193.98:0/718831802 conn(0x7f14a4100620 msgr2=0x7f14a41016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:23.171 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 shutdown_connections 2026-02-20T02:27:23.172 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:23.170+0000 7f14aa186640 1 -- 10.20.193.98:0/718831802 wait complete. 2026-02-20T02:27:23.207 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-20T02:27:19.880373+0000', 'modified': '2026-02-20T02:27:19.880395+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14550}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14550': {'gid': 14550, 'name': 'foo.trial098.qfxvya', 'rank': 0, 'incarnation': 5, 'state': 'up:creating', 'state_seq': 1, 'addr': '10.20.193.98:6835/390933865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.98:6834', 'nonce': 390933865}, {'type': 'v1', 'addr': '10.20.193.98:6835', 'nonce': 390933865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2026-02-20T02:27:23.207 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14550:up:creating 2026-02-20T02:27:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2221905510' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] up:reconnect 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.98:6834/1231687035,v1:10.20.193.98:6835/1231687035] up:boot 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.106:6834/1482206819,v1:10.20.193.106:6835/1482206819] up:boot 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: fsmap foo:1 bar:1/1 {bar:0=bar.trial098.pnrgwl=up:reconnect,foo:0=foo.trial106.alrimh=up:active} 2 up:standby 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "foo.trial098.qfxvya"}]: dispatch 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "mds metadata", "who": "bar.trial106.thijxu"}]: dispatch 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:23.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:22 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2349029956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T02:27:24.208 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T02:27:24.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/718831802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:24.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: pgmap v101: 129 pgs: 99 active+clean, 14 creating+peering, 16 unknown; 581 KiB data, 221 MiB used, 5.5 TiB / 5.5 TiB avail; 511 B/s rd, 4.5 KiB/s wr, 19 op/s 2026-02-20T02:27:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] up:rejoin 2026-02-20T02:27:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: fsmap foo:1 bar:1/1 {bar:0=bar.trial098.pnrgwl=up:rejoin,foo:0=foo.trial106.alrimh=up:active} 2 up:standby 2026-02-20T02:27:24.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:24 trial098 ceph-mon[38923]: daemon mds.bar.trial098.pnrgwl is now active in filesystem bar as rank 0 2026-02-20T02:27:24.367 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:24.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/718831802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T02:27:24.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: pgmap v101: 129 pgs: 99 active+clean, 14 creating+peering, 16 unknown; 581 KiB data, 221 MiB used, 5.5 TiB / 5.5 TiB avail; 511 B/s rd, 4.5 KiB/s wr, 19 op/s 2026-02-20T02:27:24.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] up:rejoin 2026-02-20T02:27:24.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: fsmap foo:1 bar:1/1 {bar:0=bar.trial098.pnrgwl=up:rejoin,foo:0=foo.trial106.alrimh=up:active} 2 up:standby 2026-02-20T02:27:24.369 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:24 trial106 ceph-mon[44052]: daemon mds.bar.trial098.pnrgwl is now active in filesystem bar as rank 0 2026-02-20T02:27:24.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.468+0000 7fd14343a640 1 -- 10.20.193.98:0/540357319 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c104920 msgr2=0x7fd13c104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.468+0000 7fd14343a640 1 --2- 10.20.193.98:0/540357319 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c104920 0x7fd13c104d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd1300099b0 tx=0x7fd13002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:24.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.468+0000 7fd14343a640 1 -- 10.20.193.98:0/540357319 shutdown_connections 2026-02-20T02:27:24.472 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.468+0000 7fd14343a640 1 --2- 10.20.193.98:0/540357319 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c104920 0x7fd13c104d80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.468+0000 7fd14343a640 1 --2- 10.20.193.98:0/540357319 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd13c10a920 0x7fd13c10ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.468+0000 7fd14343a640 1 -- 10.20.193.98:0/540357319 >> 10.20.193.98:0/540357319 conn(0x7fd13c100620 msgr2=0x7fd13c102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.468+0000 7fd14343a640 1 -- 10.20.193.98:0/540357319 shutdown_connections 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.468+0000 7fd14343a640 1 -- 10.20.193.98:0/540357319 wait complete. 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd14343a640 1 Processor -- start 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd14343a640 1 -- start start 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd14343a640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd13c104920 0x7fd13c1a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd14343a640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c10a920 0x7fd13c1a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd14343a640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c111bc0 con 0x7fd13c10a920 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd14343a640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c111a40 con 0x7fd13c104920 2026-02-20T02:27:24.473 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1409ae640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c10a920 0x7fd13c1a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1409ae640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c10a920 0x7fd13c1a2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60786/0 (socket says 10.20.193.98:60786) 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1409ae640 1 -- 10.20.193.98:0/1570677894 learned_addr learned my addr 10.20.193.98:0/1570677894 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1409ae640 1 -- 10.20.193.98:0/1570677894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd13c104920 msgr2=0x7fd13c1a2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1411af640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd13c104920 0x7fd13c1a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1409ae640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd13c104920 0x7fd13c1a2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1409ae640 1 -- 10.20.193.98:0/1570677894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13c19c810 con 0x7fd13c10a920 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1411af640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd13c104920 0x7fd13c1a2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd1409ae640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c10a920 0x7fd13c1a2bd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd130002410 tx=0x7fd1300028b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd12a7fc640 1 -- 10.20.193.98:0/1570677894 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd130004420 con 0x7fd13c10a920 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13c19caa0 con 0x7fd13c10a920 2026-02-20T02:27:24.474 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd12a7fc640 1 -- 10.20.193.98:0/1570677894 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fd130038a40 con 0x7fd13c10a920 2026-02-20T02:27:24.475 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd12a7fc640 1 -- 10.20.193.98:0/1570677894 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fd130041880 con 0x7fd13c10a920 2026-02-20T02:27:24.475 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.469+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13c19cfd0 con 0x7fd13c10a920 2026-02-20T02:27:24.475 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.470+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13c106060 con 0x7fd13c10a920 2026-02-20T02:27:24.475 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.470+0000 7fd12a7fc640 1 -- 10.20.193.98:0/1570677894 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fd130038bf0 con 0x7fd13c10a920 2026-02-20T02:27:24.475 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.471+0000 7fd12a7fc640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd118077550 0x7fd118079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.475 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.471+0000 7fd12a7fc640 1 -- 10.20.193.98:0/1570677894 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7fd13003e070 con 0x7fd13c10a920 2026-02-20T02:27:24.475 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.471+0000 7fd1411af640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd118077550 0x7fd118079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.475 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.471+0000 7fd1411af640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd118077550 0x7fd118079a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd12c006fd0 tx=0x7fd12c008040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:24.476 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.473+0000 7fd12a7fc640 1 -- 10.20.193.98:0/1570677894 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd13008b8e0 con 0x7fd13c10a920 2026-02-20T02:27:24.573 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.571+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd13c104d80 con 0x7fd13c10a920 2026-02-20T02:27:24.573 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.572+0000 7fd12a7fc640 1 -- 10.20.193.98:0/1570677894 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6614 (secure 0 0 0) 0x7fd13c104d80 con 0x7fd13c10a920 2026-02-20T02:27:24.574 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:27:24.574 INFO:teuthology.orchestra.run.trial098.stdout:{"epoch":10,"btime":"2026-02-20T02:27:24:535085+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"foo.trial098.qfxvya","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.98:6835/1231687035","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6834","nonce":1231687035},{"type":"v1","addr":"10.20.193.98:6835","nonce":1231687035}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24345,"name":"bar.trial106.thijxu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.106:6835/1482206819","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6834","nonce":1482206819},{"type":"v1","addr":"10.20.193.106:6835","nonce":1482206819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T02:27:17.873288+0000","modified":"2026-02-20T02:27:20.525848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24325":{"gid":24325,"name":"foo.trial106.alrimh","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"10.20.193.106:6833/3928932355","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.106:6832","nonce":3928932355},{"type":"v1","addr":"10.20.193.106:6833","nonce":3928932355}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24325,"qdb_cluster":[24325]},"id":1},{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T02:27:19.880373+0000","modified":"2026-02-20T02:27:24.535080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":58,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14560":{"gid":14560,"name":"bar.trial098.pnrgwl","rank":0,"incarnation":7,"state":"up:active","state_seq":4,"addr":"10.20.193.98:6837/3550319586","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.98:6836","nonce":3550319586},{"type":"v1","addr":"10.20.193.98:6837","nonce":3550319586}]},"join_fscid":2,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14560,"qdb_cluster":[14560]},"id":2}]} 2026-02-20T02:27:24.575 INFO:teuthology.orchestra.run.trial098.stderr:dumped fsmap epoch 10 2026-02-20T02:27:24.575 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd118077550 msgr2=0x7fd118079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.575 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd118077550 0x7fd118079a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd12c006fd0 tx=0x7fd12c008040 comp rx=0 tx=0).stop 2026-02-20T02:27:24.575 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c10a920 msgr2=0x7fd13c1a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.575 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c10a920 0x7fd13c1a2bd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd130002410 tx=0x7fd1300028b0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.575 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 shutdown_connections 2026-02-20T02:27:24.575 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fd118077550 0x7fd118079a10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.576 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fd13c10a920 0x7fd13c1a2bd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.576 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 --2- 10.20.193.98:0/1570677894 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fd13c104920 0x7fd13c1a2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.576 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 >> 10.20.193.98:0/1570677894 conn(0x7fd13c100620 msgr2=0x7fd13c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:24.576 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 shutdown_connections 2026-02-20T02:27:24.576 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.573+0000 7fd14343a640 1 -- 10.20.193.98:0/1570677894 wait complete. 2026-02-20T02:27:24.610 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-20T02:27:19.880373+0000', 'modified': '2026-02-20T02:27:24.535080+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 58, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14560}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14560': {'gid': 14560, 'name': 'bar.trial098.pnrgwl', 'rank': 0, 'incarnation': 7, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.98:6837/3550319586', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.98:6836', 'nonce': 3550319586}, {'type': 'v1', 'addr': '10.20.193.98:6837', 'nonce': 3550319586}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 14560, 'qdb_cluster': [14560]} 2026-02-20T02:27:24.611 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-20T02:27:24.611 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph tell mds.bar.trial098.pnrgwl status 2026-02-20T02:27:24.765 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:24.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 -- 10.20.193.98:0/536798893 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077620 msgr2=0x7f27d0077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 --2- 10.20.193.98:0/536798893 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077620 0x7f27d0077a00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f27c00099b0 tx=0x7f27c002f220 comp rx=0 tx=0).stop 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 -- 10.20.193.98:0/536798893 shutdown_connections 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 --2- 10.20.193.98:0/536798893 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27d0077f40 0x7f27d0113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 --2- 10.20.193.98:0/536798893 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077620 0x7f27d0077a00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 -- 10.20.193.98:0/536798893 >> 10.20.193.98:0/536798893 conn(0x7f27d0100620 msgr2=0x7f27d0102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 -- 10.20.193.98:0/536798893 shutdown_connections 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 -- 10.20.193.98:0/536798893 wait complete. 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.868+0000 7f27d7b29640 1 Processor -- start 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d7b29640 1 -- start start 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d7b29640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27d0077620 0x7f27d01a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.872 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d7b29640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077f40 0x7f27d01a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d7b29640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0116080 con 0x7f27d0077f40 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d7b29640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0115f00 con 0x7f27d0077620 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d509d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077f40 0x7f27d01a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d509d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077f40 0x7f27d01a13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60802/0 (socket says 10.20.193.98:60802) 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d509d640 1 -- 10.20.193.98:0/1596862077 learned_addr learned my addr 10.20.193.98:0/1596862077 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d589e640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27d0077620 0x7f27d01a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d509d640 1 -- 10.20.193.98:0/1596862077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27d0077620 msgr2=0x7f27d01a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d509d640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27d0077620 0x7f27d01a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d509d640 1 -- 10.20.193.98:0/1596862077 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d01a5750 con 0x7f27d0077f40 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d509d640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077f40 0x7f27d01a13c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f27c400d8d0 tx=0x7f27c400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:24.873 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27beffd640 1 -- 10.20.193.98:0/1596862077 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c4014070 con 0x7f27d0077f40 2026-02-20T02:27:24.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27beffd640 1 -- 10.20.193.98:0/1596862077 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f27c40044a0 con 0x7f27d0077f40 2026-02-20T02:27:24.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d7b29640 1 -- 10.20.193.98:0/1596862077 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d01a5a40 con 0x7f27d0077f40 2026-02-20T02:27:24.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27beffd640 1 -- 10.20.193.98:0/1596862077 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c4002dc0 con 0x7f27d0077f40 2026-02-20T02:27:24.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.869+0000 7f27d7b29640 1 -- 10.20.193.98:0/1596862077 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d01a5fd0 con 0x7f27d0077f40 2026-02-20T02:27:24.874 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.870+0000 7f27beffd640 1 -- 10.20.193.98:0/1596862077 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f27c4010460 con 0x7f27d0077f40 2026-02-20T02:27:24.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27beffd640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f27ac0775a0 0x7f27ac079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27d589e640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f27ac0775a0 0x7f27ac079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27beffd640 1 -- 10.20.193.98:0/1596862077 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f27c409afa0 con 0x7f27d0077f40 2026-02-20T02:27:24.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27da02ee00 1 Processor -- start 2026-02-20T02:27:24.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27d589e640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f27ac0775a0 0x7f27ac079a60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27c0004870 tx=0x7f27c00047c0 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:24.880 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27da02ee00 1 -- start start 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27da02ee00 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9db0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27da02ee00 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9daee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27da02ee00 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x557db9d2c120 con 0x557db9db09a0 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27da02ee00 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x557db9cfea40 con 0x557db9db0080 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27d509d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9daee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27d509d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9daee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60818/0 (socket says 10.20.193.98:60818) 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27d509d640 1 -- 10.20.193.98:0/513939341 learned_addr learned my addr 10.20.193.98:0/513939341 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.871+0000 7f27d589e640 1 --2- 10.20.193.98:0/513939341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9db0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27d509d640 1 -- 10.20.193.98:0/513939341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 msgr2=0x557db9db0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27d509d640 1 --2- 10.20.193.98:0/513939341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9db0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.881 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27d509d640 1 -- 10.20.193.98:0/513939341 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db9cb44b0 con 0x557db9db09a0 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27d509d640 1 --2- 10.20.193.98:0/513939341 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9daee20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f27c405f3f0 tx=0x7f27c4062c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290e16b013af4c49 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f279e4e6640 1 -- 10.20.193.98:0/513939341 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c401e070 con 0x557db9db09a0 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f279e4e6640 1 -- 10.20.193.98:0/513939341 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f27c405f600 con 0x557db9db09a0 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f279e4e6640 1 -- 10.20.193.98:0/513939341 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c406bd60 con 0x557db9db09a0 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27da02ee00 1 -- 10.20.193.98:0/513939341 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 msgr2=0x557db9daee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27da02ee00 1 --2- 10.20.193.98:0/513939341 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9daee20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f27c405f3f0 tx=0x7f27c4062c00 comp rx=0 tx=0).stop 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27da02ee00 1 -- 10.20.193.98:0/513939341 shutdown_connections 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27da02ee00 1 --2- 10.20.193.98:0/513939341 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9daee20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27da02ee00 1 --2- 10.20.193.98:0/513939341 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9db0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27da02ee00 1 -- 10.20.193.98:0/513939341 >> 10.20.193.98:0/513939341 conn(0x557db9da26d0 msgr2=0x557db9da9550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:24.882 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27da02ee00 1 -- 10.20.193.98:0/513939341 shutdown_connections 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.872+0000 7f27da02ee00 1 -- 10.20.193.98:0/513939341 wait complete. 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 1 -- start start 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 1 Processor -- start 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db0080 0x557db9dc4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db09a0 0x557db9dc5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x557db9cac250 con 0x557db9db0080 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x557db9ca6030 con 0x557db9db09a0 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d589e640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db0080 0x557db9dc4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d589e640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db0080 0x557db9dc4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60834/0 (socket says 10.20.193.98:60834) 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d589e640 1 -- 10.20.193.98:0/3413216369 learned_addr learned my addr 10.20.193.98:0/3413216369 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:24.883 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d509d640 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db09a0 0x557db9dc5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d589e640 1 -- 10.20.193.98:0/3413216369 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db09a0 msgr2=0x557db9dc5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d589e640 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db09a0 0x557db9dc5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d589e640 1 -- 10.20.193.98:0/3413216369 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db9dbc8c0 con 0x557db9db0080 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d509d640 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db09a0 0x557db9dc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27d589e640 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db0080 0x557db9dc4bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f27c0037000 tx=0x7f27c0009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158cf939de491086 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f278b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.98:3300/0 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f278b7fe640 1 -- 10.20.193.98:0/3413216369 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c0038790 con 0x557db9db0080 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557db9acf950 con 0x557db9db0080 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f278b7fe640 1 -- 10.20.193.98:0/3413216369 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f27c0033040 con 0x557db9db0080 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f278b7fe640 1 -- 10.20.193.98:0/3413216369 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c0045af0 con 0x557db9db0080 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 10 client.14606 _ll_register_callbacks cb 0x557db9c9fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T02:27:24.884 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557db9d06630 con 0x557db9db0080 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.873+0000 7f278b7fe640 1 -- 10.20.193.98:0/3413216369 <== mon.0 v2:10.20.193.98:3300/0 4 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f27c004c070 con 0x557db9db0080 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f278b7fe640 1 -- 10.20.193.98:0/3413216369 <== mon.0 v2:10.20.193.98:3300/0 5 ==== mon_get_version_reply(handle=1 version=10) ==== 24+0+0 (secure 0 0 0) 0x7f27c0045d40 con 0x557db9db0080 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 10 client.14606 fetch_fsmap learned FSMap version 10 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({fsmap=10}) -- 0x557db9cb93a0 con 0x557db9db0080 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f278b7fe640 1 -- 10.20.193.98:0/3413216369 <== mon.0 v2:10.20.193.98:3300/0 6 ==== fsmap(e 10) ==== 4212+0+0 (secure 0 0 0) 0x7f27c0038930 con 0x557db9db0080 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 10 client.14606 fetch_fsmap finished waiting for FSMap version 10 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 10 client.14606 resolve_mds: resolved name 'bar.trial098.pnrgwl' to daemon mds.bar.trial098.pnrgwl 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 20 client.14606 populate_metadata read hostname 'trial098' 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] conn(0x557db9dcf800 0x557db9dd3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 4 client.14606 mds_command: new command op to 14560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 --> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557db9c80bd0 con 0x557db9dcf800 2026-02-20T02:27:24.885 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27d509d640 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] conn(0x557db9dcf800 0x557db9dd3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f278b7fe640 10 client.14606 ms_handle_connect on v2:10.20.193.98:6836/3550319586 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27d509d640 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] conn(0x557db9dcf800 0x557db9dd3d30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbbca29d4bc067ca server_cookie=8d20f53c2906f3a6 in_seq=0 out_seq=0 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f278b7fe640 1 -- 10.20.193.98:0/3413216369 <== mds.0 v2:10.20.193.98:6836/3550319586 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557db9c80bd0 con 0x557db9dcf800 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f278b7fe640 10 client.14606 handle_command_reply: tid=0 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.874+0000 7f27da02ee00 1 client.14606 shutdown 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db0080 msgr2=0x557db9dc4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db0080 0x557db9dc4bf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f27c0037000 tx=0x7f27c0009340 comp rx=0 tx=0).stop 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 shutdown_connections 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] conn(0x557db9dcf800 0x557db9dd3d30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db09a0 0x557db9dc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3413216369 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db0080 0x557db9dc4bf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.886 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f278b7fe640 0 client.14606 ms_handle_reset on v2:10.20.193.98:6836/3550319586 2026-02-20T02:27:24.887 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 >> 10.20.193.98:0/3413216369 conn(0x557db9da26d0 msgr2=0x557db9dabc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:24.887 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 shutdown_connections 2026-02-20T02:27:24.887 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 1 -- 10.20.193.98:0/3413216369 wait complete. 2026-02-20T02:27:24.887 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.875+0000 7f27da02ee00 20 client.14606 trim_cache size 0 max 16384 2026-02-20T02:27:24.892 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27da02ee00 1 Processor -- start 2026-02-20T02:27:24.892 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27da02ee00 1 -- start start 2026-02-20T02:27:24.892 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27da02ee00 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9dcaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.892 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27da02ee00 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9dcafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.892 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27da02ee00 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f277c00e9e0 con 0x557db9db09a0 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27da02ee00 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f277c00c330 con 0x557db9db0080 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27d509d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9dcafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27d509d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9dcafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60848/0 (socket says 10.20.193.98:60848) 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27d509d640 1 -- 10.20.193.98:0/3668752005 learned_addr learned my addr 10.20.193.98:0/3668752005 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27d589e640 1 --2- 10.20.193.98:0/3668752005 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9dcaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27d509d640 1 -- 10.20.193.98:0/3668752005 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 msgr2=0x557db9dcaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27d509d640 1 --2- 10.20.193.98:0/3668752005 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9dcaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27d509d640 1 -- 10.20.193.98:0/3668752005 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db9dbc6f0 con 0x557db9db09a0 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f27d509d640 1 --2- 10.20.193.98:0/3668752005 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9dcafc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f27c4002fd0 tx=0x7f27c400dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c0e6764db2fda8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f279dce5640 1 -- 10.20.193.98:0/3668752005 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c401e040 con 0x557db9db09a0 2026-02-20T02:27:24.893 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f279dce5640 1 -- 10.20.193.98:0/3668752005 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f27c404bba0 con 0x557db9db09a0 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.883+0000 7f279dce5640 1 -- 10.20.193.98:0/3668752005 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c406bd60 con 0x557db9db09a0 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 -- 10.20.193.98:0/3668752005 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 msgr2=0x557db9dcafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3668752005 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9dcafc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f27c4002fd0 tx=0x7f27c400dfc0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 -- 10.20.193.98:0/3668752005 shutdown_connections 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3668752005 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9dcafc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3668752005 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9dcaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 -- 10.20.193.98:0/3668752005 >> 10.20.193.98:0/3668752005 conn(0x557db9da26d0 msgr2=0x557db9dabe90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 -- 10.20.193.98:0/3668752005 shutdown_connections 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 -- 10.20.193.98:0/3668752005 wait complete. 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 -- start start 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 Processor -- start 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9e37c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.894 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9e38170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x557db9dd0a20 con 0x557db9db09a0 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27da02ee00 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f277c00c9a0 con 0x557db9db0080 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27d509d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9e38170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27d509d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9e38170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60856/0 (socket says 10.20.193.98:60856) 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27d509d640 1 -- 10.20.193.98:0/3178363013 learned_addr learned my addr 10.20.193.98:0/3178363013 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27d509d640 1 -- 10.20.193.98:0/3178363013 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 msgr2=0x557db9e37c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27d509d640 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9e37c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.884+0000 7f27d509d640 1 -- 10.20.193.98:0/3178363013 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db99dd680 con 0x557db9db09a0 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27d509d640 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9e38170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27c405f3f0 tx=0x7f27c4002890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967d54b1a293b5b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.98:3300/0 2026-02-20T02:27:24.895 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 1 -- 10.20.193.98:0/3178363013 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c401e070 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 1 -- 10.20.193.98:0/3178363013 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f27c406bd60 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557db9c9e450 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 1 -- 10.20.193.98:0/3178363013 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f27c405eee0 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 10 client.14610 _ll_register_callbacks cb 0x7f27c0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557db9d0c220 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 1 -- 10.20.193.98:0/3178363013 <== mon.0 v2:10.20.193.98:3300/0 4 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f27c4084df0 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 1 -- 10.20.193.98:0/3178363013 <== mon.0 v2:10.20.193.98:3300/0 5 ==== mon_get_version_reply(handle=1 version=10) ==== 24+0+0 (secure 0 0 0) 0x7f27c405f140 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 10 client.14610 fetch_fsmap learned FSMap version 10 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({fsmap=10}) -- 0x557db9dbd3e0 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 1 -- 10.20.193.98:0/3178363013 <== mon.0 v2:10.20.193.98:3300/0 6 ==== fsmap(e 10) ==== 4212+0+0 (secure 0 0 0) 0x7f27c406ca70 con 0x557db9db09a0 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 10 client.14610 fetch_fsmap finished waiting for FSMap version 10 2026-02-20T02:27:24.896 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 10 client.14610 resolve_mds: resolved name 'bar.trial098.pnrgwl' to daemon mds.bar.trial098.pnrgwl 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 20 client.14610 populate_metadata read hostname 'trial098' 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] conn(0x557db9e3dd40 0x557db9e40130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 4 client.14610 mds_command: new command op to 14560 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 --> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] -- command(tid 0: {"prefix": "status"}) -- 0x7f27c405f600 con 0x557db9e3dd40 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27d589e640 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] conn(0x557db9e3dd40 0x557db9e40130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27d589e640 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] conn(0x557db9e3dd40 0x557db9e40130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816d2474c336777a server_cookie=90be4871b6156552 in_seq=0 out_seq=0 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 10 client.14610 ms_handle_connect on v2:10.20.193.98:6836/3550319586 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 1 -- 10.20.193.98:0/3178363013 <== mds.0 v2:10.20.193.98:6836/3550319586 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x7f27c405f600 con 0x557db9e3dd40 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 10 client.14610 handle_command_reply: tid=0 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 client.14610 shutdown 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 msgr2=0x557db9e38170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.897 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9e38170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27c405f3f0 tx=0x7f27c4002890 comp rx=0 tx=0).stop 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 shutdown_connections 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] conn(0x557db9e3dd40 0x557db9e40130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x557db9db09a0 0x557db9e38170 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 --2- 10.20.193.98:0/3178363013 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x557db9db0080 0x557db9e37c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f278b7fe640 0 client.14610 ms_handle_reset on v2:10.20.193.98:6836/3550319586 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.885+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 >> 10.20.193.98:0/3178363013 conn(0x557db9da26d0 msgr2=0x557db9dc1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 shutdown_connections 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27da02ee00 1 -- 10.20.193.98:0/3178363013 wait complete. 2026-02-20T02:27:24.898 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27da02ee00 20 client.14610 trim_cache size 0 max 16384 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout:{ 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "cluster_fsid": "5138774d-0e03-11f1-8edf-d404e6e7d460", 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "whoami": 0, 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "id": 14560, 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "want_state": "up:active", 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "state": "up:active", 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "fs_name": "bar", 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "rank_uptime": 3.3515032969999998, 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "mdsmap_epoch": 10, 2026-02-20T02:27:24.899 INFO:teuthology.orchestra.run.trial098.stdout: "osdmap_epoch": 58, 2026-02-20T02:27:24.900 INFO:teuthology.orchestra.run.trial098.stdout: "osdmap_epoch_barrier": 58, 2026-02-20T02:27:24.900 INFO:teuthology.orchestra.run.trial098.stdout: "uptime": 3.6340446829999999 2026-02-20T02:27:24.900 INFO:teuthology.orchestra.run.trial098.stdout:} 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 -- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f27ac0775a0 msgr2=0x7f27ac079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f27ac0775a0 0x7f27ac079a60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27c0004870 tx=0x7f27c00047c0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 -- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077f40 msgr2=0x7f27d01a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077f40 0x7f27d01a13c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f27c400d8d0 tx=0x7f27c400dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 -- 10.20.193.98:0/1596862077 shutdown_connections 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f27ac0775a0 0x7f27ac079a60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f27d0077f40 0x7f27d01a13c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 --2- 10.20.193.98:0/1596862077 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f27d0077620 0x7f27d01a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:24.901 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 -- 10.20.193.98:0/1596862077 >> 10.20.193.98:0/1596862077 conn(0x7f27d0100620 msgr2=0x7f27d0100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:24.902 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 -- 10.20.193.98:0/1596862077 shutdown_connections 2026-02-20T02:27:24.902 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:24.886+0000 7f27d7b29640 1 -- 10.20.193.98:0/1596862077 wait complete. 2026-02-20T02:27:24.920 INFO:teuthology.run_tasks:Running task ceph-fuse... 2026-02-20T02:27:24.963 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2026-02-20T02:27:24.963 INFO:tasks.ceph_fuse:config is {'client.0': {'cephfs_name': 'foo'}} 2026-02-20T02:27:24.963 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'foo'} 2026-02-20T02:27:24.963 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-20T02:27:24.963 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:24.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:24.963 DEBUG:teuthology.orchestra.run.trial098:> ip netns list 2026-02-20T02:27:24.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:24.980 DEBUG:teuthology.orchestra.run.trial098:> sudo ip link delete ceph-brx 2026-02-20T02:27:25.047 INFO:teuthology.orchestra.run.trial098.stderr:Cannot find device "ceph-brx" 2026-02-20T02:27:25.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T02:27:25.048 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2026-02-20T02:27:25.048 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2026-02-20T02:27:25.048 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph fs ls 2026-02-20T02:27:25.244 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:25.293 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:25 trial098 ceph-mon[38923]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-20T02:27:25.293 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:25 trial098 ceph-mon[38923]: Cluster is now healthy 2026-02-20T02:27:25.294 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:25 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] up:active 2026-02-20T02:27:25.294 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:25 trial098 ceph-mon[38923]: fsmap foo:1 bar:1 {bar:0=bar.trial098.pnrgwl=up:active,foo:0=foo.trial106.alrimh=up:active} 2 up:standby 2026-02-20T02:27:25.294 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:25 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/1570677894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T02:27:25.294 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:25.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 -- 10.20.193.98:0/3718534202 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 msgr2=0x7f7324107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:25.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 --2- 10.20.193.98:0/3718534202 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 0x7f7324107a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f73180099b0 tx=0x7f731802f220 comp rx=0 tx=0).stop 2026-02-20T02:27:25.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 -- 10.20.193.98:0/3718534202 shutdown_connections 2026-02-20T02:27:25.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 --2- 10.20.193.98:0/3718534202 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f7324101590 0x7f73241019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:25.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 --2- 10.20.193.98:0/3718534202 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 0x7f7324107a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:25.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 -- 10.20.193.98:0/3718534202 >> 10.20.193.98:0/3718534202 conn(0x7f73240fd230 msgr2=0x7f73240ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:25.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 -- 10.20.193.98:0/3718534202 shutdown_connections 2026-02-20T02:27:25.346 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 -- 10.20.193.98:0/3718534202 wait complete. 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 Processor -- start 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 -- start start 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f7324101590 0x7f73241a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 0x7f73241a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f732410e7a0 con 0x7f7324107640 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f732933d640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f732410e620 con 0x7f7324101590 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f73227fc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 0x7f73241a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f73227fc640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 0x7f73241a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60886/0 (socket says 10.20.193.98:60886) 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f73227fc640 1 -- 10.20.193.98:0/3186441018 learned_addr learned my addr 10.20.193.98:0/3186441018 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f7322ffd640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f7324101590 0x7f73241a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f73227fc640 1 -- 10.20.193.98:0/3186441018 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f7324101590 msgr2=0x7f73241a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:25.347 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f73227fc640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f7324101590 0x7f73241a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.342+0000 7f73227fc640 1 -- 10.20.193.98:0/3186441018 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732419c650 con 0x7f7324107640 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.343+0000 7f73227fc640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 0x7f73241a2ac0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d8d0 tx=0x7f730c00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.343+0000 7f7303fff640 1 -- 10.20.193.98:0/3186441018 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f730c014070 con 0x7f7324107640 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.343+0000 7f7303fff640 1 -- 10.20.193.98:0/3186441018 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f730c0044a0 con 0x7f7324107640 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.343+0000 7f7303fff640 1 -- 10.20.193.98:0/3186441018 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f730c002dc0 con 0x7f7324107640 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.343+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732419c940 con 0x7f7324107640 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.343+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732419cea0 con 0x7f7324107640 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.343+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7324102cb0 con 0x7f7324107640 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.344+0000 7f7303fff640 1 -- 10.20.193.98:0/3186441018 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f730c00b840 con 0x7f7324107640 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.344+0000 7f7303fff640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f72f8077550 0x7f72f8079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.344+0000 7f7322ffd640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f72f8077550 0x7f72f8079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:25.348 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.344+0000 7f7303fff640 1 -- 10.20.193.98:0/3186441018 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f730c09a180 con 0x7f7324107640 2026-02-20T02:27:25.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.345+0000 7f7322ffd640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f72f8077550 0x7f72f8079a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f73180097c0 tx=0x7f731803a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:25.349 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.346+0000 7f7303fff640 1 -- 10.20.193.98:0/3186441018 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f730c066b50 con 0x7f7324107640 2026-02-20T02:27:25.447 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.446+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f732419d1c0 con 0x7f7324107640 2026-02-20T02:27:25.448 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.446+0000 7f7303fff640 1 -- 10.20.193.98:0/3186441018 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) ==== 53+0+148 (secure 0 0 0) 0x7f730c06ba00 con 0x7f7324107640 2026-02-20T02:27:25.448 INFO:teuthology.orchestra.run.trial098.stdout:name: foo, metadata pool: cephfs.foo.meta, data pools: [cephfs.foo.data ] 2026-02-20T02:27:25.448 INFO:teuthology.orchestra.run.trial098.stdout:name: bar, metadata pool: cephfs.bar.meta, data pools: [cephfs.bar.data ] 2026-02-20T02:27:25.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f72f8077550 msgr2=0x7f72f8079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:25.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f72f8077550 0x7f72f8079a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f73180097c0 tx=0x7f731803a040 comp rx=0 tx=0).stop 2026-02-20T02:27:25.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 msgr2=0x7f73241a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:25.449 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 0x7f73241a2ac0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d8d0 tx=0x7f730c00dda0 comp rx=0 tx=0).stop 2026-02-20T02:27:25.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 shutdown_connections 2026-02-20T02:27:25.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f72f8077550 0x7f72f8079a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:25.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f7324107640 0x7f73241a2ac0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:25.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 --2- 10.20.193.98:0/3186441018 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f7324101590 0x7f73241a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:25.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 >> 10.20.193.98:0/3186441018 conn(0x7f73240fd230 msgr2=0x7f732406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:25.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 shutdown_connections 2026-02-20T02:27:25.450 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25.447+0000 7f732933d640 1 -- 10.20.193.98:0/3186441018 wait complete. 2026-02-20T02:27:25.485 INFO:tasks.cephfs.mount:Mounting Ceph FS foo; just confirmed its presence on cluster 2026-02-20T02:27:25.485 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-20T02:27:25.485 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial098.front.sepia.ceph.com 2026-02-20T02:27:25.485 INFO:tasks.cephfs.mount:self.client.name = client.0 2026-02-20T02:27:25.485 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:25.485 INFO:tasks.cephfs.mount:self.cephfs_name = foo 2026-02-20T02:27:25.485 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-20T02:27:25.485 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-20T02:27:25.486 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2026-02-20T02:27:25.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:25.486 DEBUG:teuthology.orchestra.run.trial098:> ip addr 2026-02-20T02:27:25.503 INFO:teuthology.orchestra.run.trial098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-20T02:27:25.504 INFO:teuthology.orchestra.run.trial098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-20T02:27:25.504 INFO:teuthology.orchestra.run.trial098.stdout: inet 127.0.0.1/8 scope host lo 2026-02-20T02:27:25.504 INFO:teuthology.orchestra.run.trial098.stdout: valid_lft forever preferred_lft forever 2026-02-20T02:27:25.504 INFO:teuthology.orchestra.run.trial098.stdout: inet6 ::1/128 scope host 2026-02-20T02:27:25.504 INFO:teuthology.orchestra.run.trial098.stdout: valid_lft forever preferred_lft forever 2026-02-20T02:27:25.504 INFO:teuthology.orchestra.run.trial098.stdout:2: enp7s0f4u2u2c2: mtu 1500 qdisc fq_codel state UNKNOWN group default qlen 1000 2026-02-20T02:27:25.504 INFO:teuthology.orchestra.run.trial098.stdout: link/ether 22:e5:00:25:1a:a7 brd ff:ff:ff:ff:ff:ff 2026-02-20T02:27:25.504 INFO:teuthology.orchestra.run.trial098.stdout: inet 169.254.3.1/24 brd 169.254.3.255 scope link dynamic noprefixroute enp7s0f4u2u2c2 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: valid_lft 863530sec preferred_lft 863530sec 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: inet6 fe80::407e:a9b9:1a53:2a73/64 scope link noprefixroute 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: valid_lft forever preferred_lft forever 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout:3: enp1s0f0: mtu 1500 qdisc mq state UP group default qlen 1000 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: link/ether 90:5a:08:77:61:ec brd ff:ff:ff:ff:ff:ff 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: inet 10.20.193.98/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: valid_lft 881sec preferred_lft 881sec 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: inet6 fe80::925a:8ff:fe77:61ec/64 scope link 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: valid_lft forever preferred_lft forever 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout:4: enp1s0f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2026-02-20T02:27:25.505 INFO:teuthology.orchestra.run.trial098.stdout: link/ether 90:5a:08:77:61:ed brd ff:ff:ff:ff:ff:ff 2026-02-20T02:27:25.506 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-20T02:27:25.506 DEBUG:teuthology.orchestra.run.trial098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:25.506 DEBUG:teuthology.orchestra.run.trial098:> set -e 2026-02-20T02:27:25.507 DEBUG:teuthology.orchestra.run.trial098:> sudo ip link add name ceph-brx type bridge 2026-02-20T02:27:25.507 DEBUG:teuthology.orchestra.run.trial098:> sudo ip addr flush dev ceph-brx 2026-02-20T02:27:25.507 DEBUG:teuthology.orchestra.run.trial098:> sudo ip link set ceph-brx up 2026-02-20T02:27:25.507 DEBUG:teuthology.orchestra.run.trial098:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-20T02:27:25.507 DEBUG:teuthology.orchestra.run.trial098:> ') 2026-02-20T02:27:25.577 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:25.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:25 trial106 ceph-mon[44052]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-20T02:27:25.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:25 trial106 ceph-mon[44052]: Cluster is now healthy 2026-02-20T02:27:25.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:25 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.98:6836/3550319586,v1:10.20.193.98:6837/3550319586] up:active 2026-02-20T02:27:25.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:25 trial106 ceph-mon[44052]: fsmap foo:1 bar:1 {bar:0=bar.trial098.pnrgwl=up:active,foo:0=foo.trial106.alrimh=up:active} 2 up:standby 2026-02-20T02:27:25.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:25 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/1570677894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T02:27:25.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:25.648 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:25.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:25.652 DEBUG:teuthology.orchestra.run.trial098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-20T02:27:25.716 INFO:teuthology.orchestra.run.trial098.stdout:1 2026-02-20T02:27:25.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:25.718 DEBUG:teuthology.orchestra.run.trial098:> ip r 2026-02-20T02:27:25.775 INFO:teuthology.orchestra.run.trial098.stdout:default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.98 metric 102 2026-02-20T02:27:25.775 INFO:teuthology.orchestra.run.trial098.stdout:10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.98 metric 102 2026-02-20T02:27:25.775 INFO:teuthology.orchestra.run.trial098.stdout:169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-20T02:27:25.775 INFO:teuthology.orchestra.run.trial098.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-20T02:27:25.775 DEBUG:teuthology.orchestra.run.trial098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:25.775 DEBUG:teuthology.orchestra.run.trial098:> set -e 2026-02-20T02:27:25.775 DEBUG:teuthology.orchestra.run.trial098:> sudo iptables -A FORWARD -o enp1s0f0 -i ceph-brx -j ACCEPT 2026-02-20T02:27:25.776 DEBUG:teuthology.orchestra.run.trial098:> sudo iptables -A FORWARD -i enp1s0f0 -o ceph-brx -j ACCEPT 2026-02-20T02:27:25.776 DEBUG:teuthology.orchestra.run.trial098:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0 -j MASQUERADE 2026-02-20T02:27:25.776 DEBUG:teuthology.orchestra.run.trial098:> ') 2026-02-20T02:27:25.850 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:25.984 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:25.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:25.989 DEBUG:teuthology.orchestra.run.trial098:> ip netns list 2026-02-20T02:27:26.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:26.045 DEBUG:teuthology.orchestra.run.trial098:> ip netns list-id 2026-02-20T02:27:26.101 DEBUG:teuthology.orchestra.run.trial098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:26.101 DEBUG:teuthology.orchestra.run.trial098:> set -e 2026-02-20T02:27:26.101 DEBUG:teuthology.orchestra.run.trial098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T02:27:26.101 DEBUG:teuthology.orchestra.run.trial098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2026-02-20T02:27:26.101 DEBUG:teuthology.orchestra.run.trial098:> ') 2026-02-20T02:27:26.175 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:26.195 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:26.199 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.144.1/20 2026-02-20T02:27:26.199 DEBUG:teuthology.orchestra.run.trial098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:26.199 DEBUG:teuthology.orchestra.run.trial098:> set -e 2026-02-20T02:27:26.200 DEBUG:teuthology.orchestra.run.trial098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2026-02-20T02:27:26.200 DEBUG:teuthology.orchestra.run.trial098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-20T02:27:26.200 DEBUG:teuthology.orchestra.run.trial098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2026-02-20T02:27:26.200 DEBUG:teuthology.orchestra.run.trial098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2026-02-20T02:27:26.200 DEBUG:teuthology.orchestra.run.trial098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.159.254 2026-02-20T02:27:26.200 DEBUG:teuthology.orchestra.run.trial098:> ') 2026-02-20T02:27:26.272 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:26.327 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:26.332 DEBUG:teuthology.orchestra.run.trial098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:26.332 DEBUG:teuthology.orchestra.run.trial098:> set -e 2026-02-20T02:27:26.332 DEBUG:teuthology.orchestra.run.trial098:> sudo ip link set brx.0 up 2026-02-20T02:27:26.332 DEBUG:teuthology.orchestra.run.trial098:> sudo ip link set dev brx.0 master ceph-brx 2026-02-20T02:27:26.332 DEBUG:teuthology.orchestra.run.trial098:> ') 2026-02-20T02:27:26.406 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:26.412 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:26 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/3186441018' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T02:27:26.412 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:26 trial098 ceph-mon[38923]: pgmap v102: 129 pgs: 129 active+clean; 581 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 2.3 KiB/s rd, 3.6 KiB/s wr, 16 op/s 2026-02-20T02:27:26.439 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:26.444 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'foo'} 2026-02-20T02:27:26.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T02:27:26.444 DEBUG:teuthology.orchestra.run.trial098:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:26.499 INFO:teuthology.orchestra.run.trial098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2026-02-20T02:27:26.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T02:27:26.500 DEBUG:teuthology.orchestra.run.trial098:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:26.555 DEBUG:teuthology.orchestra.run.trial098:> sudo modprobe fuse 2026-02-20T02:27:26.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:26 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/3186441018' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T02:27:26.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:26 trial106 ceph-mon[44052]: pgmap v102: 129 pgs: 129 active+clean; 581 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 2.3 KiB/s rd, 3.6 KiB/s wr, 16 op/s 2026-02-20T02:27:26.618 DEBUG:teuthology.orchestra.run.trial098:> cat /proc/self/mounts | awk '{print $2}' 2026-02-20T02:27:26.673 INFO:teuthology.orchestra.run.trial098.stdout:/proc 2026-02-20T02:27:26.673 INFO:teuthology.orchestra.run.trial098.stdout:/sys 2026-02-20T02:27:26.673 INFO:teuthology.orchestra.run.trial098.stdout:/dev 2026-02-20T02:27:26.673 INFO:teuthology.orchestra.run.trial098.stdout:/sys/kernel/security 2026-02-20T02:27:26.673 INFO:teuthology.orchestra.run.trial098.stdout:/dev/shm 2026-02-20T02:27:26.673 INFO:teuthology.orchestra.run.trial098.stdout:/dev/pts 2026-02-20T02:27:26.673 INFO:teuthology.orchestra.run.trial098.stdout:/run 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/cgroup 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/pstore 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/firmware/efi/efivars 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/bpf 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/kernel/config 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/ 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/selinux 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/dev/hugepages 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/dev/mqueue 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/kernel/debug 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/kernel/tracing 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/fuse/connections 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/run/credentials/systemd-sysctl.service 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/boot/efi 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/nfs/rpc_pipefs 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/run/user/1000 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/ceph 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/ab8ef0febf98445bc7723a2ce72dce5bd84019b75e7d3898a0bebc7dfd687a07/merged 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/0adf2128477e82e1aa55bd2be74eaa1458d66f025d0b8c6b3e86a69c92325b4d/merged 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/run/user/0 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T02:27:26.674 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/192755540d35b67de751c41f650df3ea98eece81b88dc7edfd3508f5137cf268/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/b106a4cf4c4a0749c5554468f08c26fbf37aa8124aff626206a9cd966e8653e4/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/b86d14bfdeabf92bd01ecb7729cbc397f9cf135dfe16c468d456e13099ff544c/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/95e4195ace8860c15ccda13a46412ae97c8ec43a4f6587f42b4dcb8258178c5a/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/f8a037ccec3e35748d06d5c929fa7c2c413545258d732dcaa9b0c2641d3ee964/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/2eb1b52eeaba6df4d8bc186347fb5266eb3230701369be93ec2474639598d4fd/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/6880cd3b17ee304c368f7d9d5c817224da1ab7bfd2db0abca27938edcc5384ca/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/eb61e47f32d4a1e9158a4c4b7a717ccf8373eb71c74f08bef0a9db0e1e1837ec/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/277a07a7fd855865ae42b8565a8be5a848d5f329c45d905d48f0df6e415a0a1d/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/b7babac37b3f69bfe5a2c9d0248a7ea818baa33043f42663dba9c35723eb5cd9/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/8bb6b02d9f54f375fc51dd051d5fa2dcb02d1b151c38021affa03677f6590a52/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/26e88da540694d9f3583efbaa2640500abc96c4a78c7c7b8b37706c5c50e10d0/merged 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/run/netns 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T02:27:26.675 INFO:teuthology.orchestra.run.trial098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T02:27:26.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:26.676 DEBUG:teuthology.orchestra.run.trial098:> ls /sys/fs/fuse/connections 2026-02-20T02:27:26.731 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2026-02-20T02:27:26.731 DEBUG:teuthology.orchestra.run.trial098:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=foo) 2026-02-20T02:27:26.773 DEBUG:teuthology.orchestra.run.trial098:> sudo modprobe fuse 2026-02-20T02:27:26.797 DEBUG:teuthology.orchestra.run.trial098:> cat /proc/self/mounts | awk '{print $2}' 2026-02-20T02:27:26.855 INFO:teuthology.orchestra.run.trial098.stdout:/proc 2026-02-20T02:27:26.855 INFO:teuthology.orchestra.run.trial098.stdout:/sys 2026-02-20T02:27:26.855 INFO:teuthology.orchestra.run.trial098.stdout:/dev 2026-02-20T02:27:26.855 INFO:teuthology.orchestra.run.trial098.stdout:/sys/kernel/security 2026-02-20T02:27:26.855 INFO:teuthology.orchestra.run.trial098.stdout:/dev/shm 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/dev/pts 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/run 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/cgroup 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/pstore 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/firmware/efi/efivars 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/bpf 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/kernel/config 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/ 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/selinux 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/dev/hugepages 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/dev/mqueue 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/kernel/debug 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/kernel/tracing 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/sys/fs/fuse/connections 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/run/credentials/systemd-sysctl.service 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/boot/efi 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/nfs/rpc_pipefs 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/run/user/1000 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/ceph 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/ab8ef0febf98445bc7723a2ce72dce5bd84019b75e7d3898a0bebc7dfd687a07/merged 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/0adf2128477e82e1aa55bd2be74eaa1458d66f025d0b8c6b3e86a69c92325b4d/merged 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/run/user/0 2026-02-20T02:27:26.856 INFO:teuthology.orchestra.run.trial098.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/192755540d35b67de751c41f650df3ea98eece81b88dc7edfd3508f5137cf268/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/b106a4cf4c4a0749c5554468f08c26fbf37aa8124aff626206a9cd966e8653e4/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/b86d14bfdeabf92bd01ecb7729cbc397f9cf135dfe16c468d456e13099ff544c/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/95e4195ace8860c15ccda13a46412ae97c8ec43a4f6587f42b4dcb8258178c5a/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/f8a037ccec3e35748d06d5c929fa7c2c413545258d732dcaa9b0c2641d3ee964/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/2eb1b52eeaba6df4d8bc186347fb5266eb3230701369be93ec2474639598d4fd/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/6880cd3b17ee304c368f7d9d5c817224da1ab7bfd2db0abca27938edcc5384ca/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/eb61e47f32d4a1e9158a4c4b7a717ccf8373eb71c74f08bef0a9db0e1e1837ec/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/277a07a7fd855865ae42b8565a8be5a848d5f329c45d905d48f0df6e415a0a1d/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/b7babac37b3f69bfe5a2c9d0248a7ea818baa33043f42663dba9c35723eb5cd9/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/8bb6b02d9f54f375fc51dd051d5fa2dcb02d1b151c38021affa03677f6590a52/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/var/lib/containers/storage/overlay/26e88da540694d9f3583efbaa2640500abc96c4a78c7c7b8b37706c5c50e10d0/merged 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/run/netns 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T02:27:26.857 INFO:teuthology.orchestra.run.trial098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T02:27:26.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:26.858 DEBUG:teuthology.orchestra.run.trial098:> ls /sys/fs/fuse/connections 2026-02-20T02:27:26.858 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial098.stderr:2026-02-20T02:27:26.855+0000 7fb23cbcc580 -1 init, newargv = 0x562546bcf390 newargc=15 2026-02-20T02:27:26.858 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial098.stderr:ceph-fuse[90596]: starting ceph client 2026-02-20T02:27:26.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial098.stderr:ceph-fuse[90596]: starting fuse 2026-02-20T02:27:26.876 INFO:teuthology.orchestra.run.trial098.stdout:44 2026-02-20T02:27:26.876 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> sudo stdin-killer -- python3 -c ' 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> import glob 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> import re 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> import os 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> import subprocess 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> def _find_admin_socket(client_name): 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2026-02-20T02:27:26.876 DEBUG:teuthology.orchestra.run.trial098:> files = glob.glob(asok_path) 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> # Given a non-glob path, it better be there 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> if "*" not in asok_path: 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> assert(len(files) == 1) 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> return files[0] 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> for f in files: 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> if os.path.exists("/proc/{0}".format(pid)): 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> contents = proc_f.read() 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> if mountpoint in contents: 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> return f 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> print(_find_admin_socket("client.0")) 2026-02-20T02:27:26.877 DEBUG:teuthology.orchestra.run.trial098:> ' 2026-02-20T02:27:26.969 INFO:teuthology.orchestra.run.trial098.stdout:/var/run/ceph/ceph-client.0.90596.asok 2026-02-20T02:27:26.970 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:26.975 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.90596.asok 2026-02-20T02:27:26.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:26.975 DEBUG:teuthology.orchestra.run.trial098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.90596.asok status 2026-02-20T02:27:27.075 INFO:teuthology.orchestra.run.trial098.stdout:{ 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: "metadata": { 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: "ceph_sha1": "f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03", 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: "ceph_version": "ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable)", 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: "entity_id": "0", 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: "hostname": "trial098", 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: "pid": "90596", 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: "root": "/" 2026-02-20T02:27:27.076 INFO:teuthology.orchestra.run.trial098.stdout: }, 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "dentry_count": 0, 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "dentry_pinned_count": 0, 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "id": 14618, 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "inst": { 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "name": { 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "type": "client", 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "num": 14618 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: }, 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "addr": { 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "type": "v1", 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "addr": "192.168.144.1:0", 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: "nonce": 4243039643 2026-02-20T02:27:27.077 INFO:teuthology.orchestra.run.trial098.stdout: } 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: }, 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: "addr": { 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: "type": "v1", 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: "addr": "192.168.144.1:0", 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: "nonce": 4243039643 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: }, 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: "inst_str": "client.14618 192.168.144.1:0/4243039643", 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: "addr_str": "192.168.144.1:0/4243039643", 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: "inode_count": 1, 2026-02-20T02:27:27.078 INFO:teuthology.orchestra.run.trial098.stdout: "mds_epoch": 5, 2026-02-20T02:27:27.079 INFO:teuthology.orchestra.run.trial098.stdout: "osd_epoch": 58, 2026-02-20T02:27:27.079 INFO:teuthology.orchestra.run.trial098.stdout: "osd_epoch_barrier": 0, 2026-02-20T02:27:27.079 INFO:teuthology.orchestra.run.trial098.stdout: "blocklisted": false, 2026-02-20T02:27:27.079 INFO:teuthology.orchestra.run.trial098.stdout: "fs_name": "foo" 2026-02-20T02:27:27.079 INFO:teuthology.orchestra.run.trial098.stdout:} 2026-02-20T02:27:27.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:27.081 DEBUG:teuthology.orchestra.run.trial098:> stat --file-system '--printf=%T 2026-02-20T02:27:27.081 DEBUG:teuthology.orchestra.run.trial098:> ' -- /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:27.097 INFO:teuthology.orchestra.run.trial098.stdout:fuseblk 2026-02-20T02:27:27.097 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:27.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:27.098 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:27.162 INFO:teuthology.run_tasks:Running task ceph-fuse... 2026-02-20T02:27:27.183 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2026-02-20T02:27:27.183 INFO:tasks.ceph_fuse:config is {'client.1': {'cephfs_name': 'bar'}} 2026-02-20T02:27:27.183 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'bar'} 2026-02-20T02:27:27.183 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-20T02:27:27.184 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:27.184 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:27:27.184 DEBUG:teuthology.orchestra.run.trial098:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T02:27:27.221 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:27:27.221 DEBUG:teuthology.orchestra.run.trial098:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T02:27:27.280 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd blocklist ls 2026-02-20T02:27:27.340 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:27 trial098 ceph-mon[38923]: mds.? [v2:10.20.193.106:6834/1482206819,v1:10.20.193.106:6835/1482206819] up:standby 2026-02-20T02:27:27.340 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:27 trial098 ceph-mon[38923]: fsmap foo:1 bar:1 {bar:0=bar.trial098.pnrgwl=up:active,foo:0=foo.trial106.alrimh=up:active} 2 up:standby 2026-02-20T02:27:27.475 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:27.591 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/377006511 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075d30 msgr2=0x7fe3f410ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:27.591 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 --2- 10.20.193.98:0/377006511 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075d30 0x7fe3f410ea40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80099b0 tx=0x7fe3e802f2b0 comp rx=0 tx=0).stop 2026-02-20T02:27:27.591 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/377006511 shutdown_connections 2026-02-20T02:27:27.591 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 --2- 10.20.193.98:0/377006511 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075d30 0x7fe3f410ea40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:27.591 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 --2- 10.20.193.98:0/377006511 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe3f4075410 0x7fe3f40757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:27.591 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/377006511 >> 10.20.193.98:0/377006511 conn(0x7fe3f40fe360 msgr2=0x7fe3f4100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:27.591 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/377006511 shutdown_connections 2026-02-20T02:27:27.591 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/377006511 wait complete. 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 Processor -- start 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 -- start start 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075410 0x7fe3f41a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe3f4075d30 0x7fe3f41a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4111af0 con 0x7fe3f4075410 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3fb5ec640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4111970 con 0x7fe3f4075d30 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3f9361640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075410 0x7fe3f41a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3f9361640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075410 0x7fe3f41a2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:60912/0 (socket says 10.20.193.98:60912) 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3f9361640 1 -- 10.20.193.98:0/935774017 learned_addr learned my addr 10.20.193.98:0/935774017 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.587+0000 7fe3f8b60640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe3f4075d30 0x7fe3f41a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:27.592 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3f9361640 1 -- 10.20.193.98:0/935774017 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe3f4075d30 msgr2=0x7fe3f41a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3f9361640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe3f4075d30 0x7fe3f41a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3f9361640 1 -- 10.20.193.98:0/935774017 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f419c620 con 0x7fe3f4075410 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3f8b60640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe3f4075d30 0x7fe3f41a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3f9361640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075410 0x7fe3f41a2460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400e990 tx=0x7fe3e400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3e27fc640 1 -- 10.20.193.98:0/935774017 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe3e400cb80 con 0x7fe3f4075410 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3e27fc640 1 -- 10.20.193.98:0/935774017 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fe3e4004540 con 0x7fe3f4075410 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f419c910 con 0x7fe3f4075410 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3e27fc640 1 -- 10.20.193.98:0/935774017 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe3e4002e60 con 0x7fe3f4075410 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f419cea0 con 0x7fe3f4075410 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.588+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f4076b50 con 0x7fe3f4075410 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.589+0000 7fe3e27fc640 1 -- 10.20.193.98:0/935774017 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fe3e4020030 con 0x7fe3f4075410 2026-02-20T02:27:27.593 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.589+0000 7fe3e27fc640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe3d0077550 0x7fe3d0079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:27.594 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.589+0000 7fe3e27fc640 1 -- 10.20.193.98:0/935774017 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7fe3e409a0c0 con 0x7fe3f4075410 2026-02-20T02:27:27.594 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.589+0000 7fe3f8b60640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe3d0077550 0x7fe3d0079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:27.594 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.590+0000 7fe3f8b60640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe3d0077550 0x7fe3d0079a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3f410bc50 tx=0x7fe3e803a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:27.594 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.591+0000 7fe3e27fc640 1 -- 10.20.193.98:0/935774017 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe3e4066b30 con 0x7fe3f4075410 2026-02-20T02:27:27.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:27 trial106 ceph-mon[44052]: mds.? [v2:10.20.193.106:6834/1482206819,v1:10.20.193.106:6835/1482206819] up:standby 2026-02-20T02:27:27.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:27 trial106 ceph-mon[44052]: fsmap foo:1 bar:1 {bar:0=bar.trial098.pnrgwl=up:active,foo:0=foo.trial106.alrimh=up:active} 2 up:standby 2026-02-20T02:27:27.680 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.679+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe3f419d100 con 0x7fe3f4075410 2026-02-20T02:27:27.681 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.679+0000 7fe3e27fc640 1 -- 10.20.193.98:0/935774017 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v58) ==== 81+0+999 (secure 0 0 0) 0x7fe3e4069e20 con 0x7fe3f4075410 2026-02-20T02:27:27.681 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/2186036449 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:27.681 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/892283834 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:27.681 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/4072581924 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:27.681 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6834/390933865 2026-02-21T02:27:21.531921+0000 2026-02-20T02:27:27.681 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/757881106 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:27.681 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/802451532 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/802451532 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/2682971939 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/180891152 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6835/390933865 2026-02-21T02:27:21.531921+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/494053877 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/635628968 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/433631514 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/3304232391 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/2682971939 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/892283834 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:27.682 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/3223427167 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:27.683 INFO:teuthology.orchestra.run.trial098.stderr:listed 17 entries 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe3d0077550 msgr2=0x7fe3d0079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe3d0077550 0x7fe3d0079a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3f410bc50 tx=0x7fe3e803a040 comp rx=0 tx=0).stop 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075410 msgr2=0x7fe3f41a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075410 0x7fe3f41a2460 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe3e400e990 tx=0x7fe3e400ee60 comp rx=0 tx=0).stop 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 shutdown_connections 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fe3d0077550 0x7fe3d0079a10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fe3f4075d30 0x7fe3f41a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 --2- 10.20.193.98:0/935774017 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fe3f4075410 0x7fe3f41a2460 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 >> 10.20.193.98:0/935774017 conn(0x7fe3f40fe360 msgr2=0x7fe3f4106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 shutdown_connections 2026-02-20T02:27:27.684 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:27.680+0000 7fe3fb5ec640 1 -- 10.20.193.98:0/935774017 wait complete. 2026-02-20T02:27:27.717 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:27:27.717 DEBUG:teuthology.orchestra.run.trial098:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T02:27:27.777 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd blocklist ls 2026-02-20T02:27:27.976 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:28.091 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.087+0000 7f5032d40640 1 -- 10.20.193.98:0/3431342853 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c104920 msgr2=0x7f502c104d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:28.091 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.087+0000 7f5032d40640 1 --2- 10.20.193.98:0/3431342853 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c104920 0x7f502c104d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f50140099b0 tx=0x7f501402f220 comp rx=0 tx=0).stop 2026-02-20T02:27:28.091 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.087+0000 7f5032d40640 1 -- 10.20.193.98:0/3431342853 shutdown_connections 2026-02-20T02:27:28.091 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.087+0000 7f5032d40640 1 --2- 10.20.193.98:0/3431342853 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c104920 0x7f502c104d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:28.091 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.087+0000 7f5032d40640 1 --2- 10.20.193.98:0/3431342853 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f502c10a920 0x7f502c10ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:28.091 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.087+0000 7f5032d40640 1 -- 10.20.193.98:0/3431342853 >> 10.20.193.98:0/3431342853 conn(0x7f502c100620 msgr2=0x7f502c102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.087+0000 7f5032d40640 1 -- 10.20.193.98:0/3431342853 shutdown_connections 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.087+0000 7f5032d40640 1 -- 10.20.193.98:0/3431342853 wait complete. 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5032d40640 1 Processor -- start 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5032d40640 1 -- start start 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5032d40640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f502c104920 0x7f502c1a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5032d40640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c10a920 0x7f502c1a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5032d40640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7f502c111b60 con 0x7f502c10a920 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5032d40640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1119e0 con 0x7f502c104920 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5023fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c10a920 0x7f502c1a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5023fff640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c10a920 0x7f502c1a2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:43136/0 (socket says 10.20.193.98:43136) 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5023fff640 1 -- 10.20.193.98:0/4110360252 learned_addr learned my addr 10.20.193.98:0/4110360252 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:28.092 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5030ab5640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f502c104920 0x7f502c1a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5023fff640 1 -- 10.20.193.98:0/4110360252 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f502c104920 msgr2=0x7f502c1a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5023fff640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f502c104920 0x7f502c1a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5023fff640 1 -- 10.20.193.98:0/4110360252 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c19c7b0 con 0x7f502c10a920 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5030ab5640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f502c104920 0x7f502c1a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.088+0000 7f5023fff640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c10a920 0x7f502c1a2b70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f501402f730 tx=0x7f501402fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.089+0000 7f5021ffb640 1 -- 10.20.193.98:0/4110360252 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5014004260 con 0x7f502c10a920 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.089+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c19ca40 con 0x7f502c10a920 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.089+0000 7f5021ffb640 1 -- 10.20.193.98:0/4110360252 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f5014004400 con 0x7f502c10a920 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.089+0000 7f5021ffb640 1 -- 10.20.193.98:0/4110360252 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f50140417b0 con 0x7f502c10a920 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.089+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c19cf70 con 0x7f502c10a920 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.089+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502c106060 con 0x7f502c10a920 2026-02-20T02:27:28.093 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.090+0000 7f5021ffb640 1 -- 10.20.193.98:0/4110360252 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7f50140385d0 con 0x7f502c10a920 2026-02-20T02:27:28.094 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.090+0000 7f5021ffb640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5008077550 0x7f5008079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:28.095 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.090+0000 7f5021ffb640 1 -- 10.20.193.98:0/4110360252 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7220+0+0 (secure 0 0 0) 0x7f501403e070 con 0x7f502c10a920 2026-02-20T02:27:28.095 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.090+0000 7f5030ab5640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5008077550 0x7f5008079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:28.095 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.090+0000 7f5030ab5640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5008077550 0x7f5008079a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f501c0046d0 tx=0x7f501c004420 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:28.095 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.092+0000 7f5021ffb640 1 -- 10.20.193.98:0/4110360252 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f501408b700 con 0x7f502c10a920 2026-02-20T02:27:28.181 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.180+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f502c19dce0 con 0x7f502c10a920 2026-02-20T02:27:28.182 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.180+0000 7f5021ffb640 1 -- 10.20.193.98:0/4110360252 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v58) ==== 81+0+999 (secure 0 0 0) 0x7f50140905b0 con 0x7f502c10a920 2026-02-20T02:27:28.182 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/2186036449 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:28.182 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/892283834 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:28.182 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/4072581924 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:28.182 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6834/390933865 2026-02-21T02:27:21.531921+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/757881106 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/802451532 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/802451532 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/2682971939 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/180891152 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6835/390933865 2026-02-21T02:27:21.531921+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/494053877 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/635628968 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/433631514 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/3304232391 2026-02-21T02:25:05.975323+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/2682971939 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:28.183 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/892283834 2026-02-21T02:25:33.491288+0000 2026-02-20T02:27:28.184 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/3223427167 2026-02-21T02:25:15.462934+0000 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:listed 17 entries 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5008077550 msgr2=0x7f5008079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5008077550 0x7f5008079a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f501c0046d0 tx=0x7f501c004420 comp rx=0 tx=0).stop 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c10a920 msgr2=0x7f502c1a2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c10a920 0x7f502c1a2b70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f501402f730 tx=0x7f501402fd20 comp rx=0 tx=0).stop 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 shutdown_connections 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7f5008077550 0x7f5008079a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7f502c10a920 0x7f502c1a2b70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 --2- 10.20.193.98:0/4110360252 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7f502c104920 0x7f502c1a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:28.185 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 >> 10.20.193.98:0/4110360252 conn(0x7f502c100620 msgr2=0x7f502c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:28.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 shutdown_connections 2026-02-20T02:27:28.186 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:28.181+0000 7f5032d40640 1 -- 10.20.193.98:0/4110360252 wait complete. 2026-02-20T02:27:28.219 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@trial098.front.sepia.ceph.com... 2026-02-20T02:27:28.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:28.219 DEBUG:teuthology.orchestra.run.trial098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:28.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial098.stderr:ceph-fuse[90596]: fuse finished with error 0 and tester_r 0 2026-02-20T02:27:28.245 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T02:27:28.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:28 trial098 ceph-mon[38923]: pgmap v103: 129 pgs: 129 active+clean; 581 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 2.7 KiB/s wr, 18 op/s 2026-02-20T02:27:28.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:28 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/935774017' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T02:27:28.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:28 trial106 ceph-mon[44052]: pgmap v103: 129 pgs: 129 active+clean; 581 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 2.7 KiB/s wr, 18 op/s 2026-02-20T02:27:28.618 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:28 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/935774017' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T02:27:29.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:29 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/4110360252' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T02:27:29.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:29 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/4110360252' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T02:27:30.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:30 trial098 ceph-mon[38923]: pgmap v104: 129 pgs: 129 active+clean; 582 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 2.5 KiB/s wr, 18 op/s 2026-02-20T02:27:30.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:30 trial106 ceph-mon[44052]: pgmap v104: 129 pgs: 129 active+clean; 582 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 2.5 KiB/s wr, 18 op/s 2026-02-20T02:27:32.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:32 trial098 ceph-mon[38923]: pgmap v105: 129 pgs: 129 active+clean; 582 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T02:27:32.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:32 trial106 ceph-mon[44052]: pgmap v105: 129 pgs: 129 active+clean; 582 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2026-02-20T02:27:33.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2026-02-20T02:27:33.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2026-02-20T02:27:33.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2026-02-20T02:27:33.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2026-02-20T02:27:33.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:33.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:27:33.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2026-02-20T02:27:33.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2026-02-20T02:27:33.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2026-02-20T02:27:33.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2026-02-20T02:27:33.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:27:33.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:27:34.346 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial098.front.sepia.ceph.com 2026-02-20T02:27:34.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:34.347 DEBUG:teuthology.orchestra.run.trial098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2026-02-20T02:27:34.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:34.365 DEBUG:teuthology.orchestra.run.trial106:> ip netns list 2026-02-20T02:27:34.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:34.386 DEBUG:teuthology.orchestra.run.trial106:> sudo ip link delete ceph-brx 2026-02-20T02:27:34.454 INFO:teuthology.orchestra.run.trial106.stderr:Cannot find device "ceph-brx" 2026-02-20T02:27:34.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T02:27:34.456 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2026-02-20T02:27:34.456 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2026-02-20T02:27:34.457 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph fs ls 2026-02-20T02:27:34.613 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:27:34.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 -- 10.20.193.98:0/615641048 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 msgr2=0x7febb4113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:34.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 --2- 10.20.193.98:0/615641048 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 0x7febb4113200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feba40099b0 tx=0x7feba402f260 comp rx=0 tx=0).stop 2026-02-20T02:27:34.720 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 -- 10.20.193.98:0/615641048 shutdown_connections 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 --2- 10.20.193.98:0/615641048 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 0x7febb4113200 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 --2- 10.20.193.98:0/615641048 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7febb4077620 0x7febb4077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 -- 10.20.193.98:0/615641048 >> 10.20.193.98:0/615641048 conn(0x7febb4100620 msgr2=0x7febb4102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 -- 10.20.193.98:0/615641048 shutdown_connections 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 -- 10.20.193.98:0/615641048 wait complete. 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 Processor -- start 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 -- start start 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7febb4077620 0x7febb41a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 0x7febb41a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7febb4116010 con 0x7febb4077f40 2026-02-20T02:27:34.721 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febba011640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7febb4115e90 con 0x7febb4077620 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febb2ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 0x7febb41a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febb2ffd640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 0x7febb41a1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:43154/0 (socket says 10.20.193.98:43154) 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febb2ffd640 1 -- 10.20.193.98:0/394899142 learned_addr learned my addr 10.20.193.98:0/394899142 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febb2ffd640 1 -- 10.20.193.98:0/394899142 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7febb4077620 msgr2=0x7febb41a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febb2ffd640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7febb4077620 0x7febb41a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.717+0000 7febb2ffd640 1 -- 10.20.193.98:0/394899142 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb41a56b0 con 0x7febb4077f40 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.718+0000 7febb2ffd640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 0x7febb41a1320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feba402f770 tx=0x7feba402fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.718+0000 7febb0ff9640 1 -- 10.20.193.98:0/394899142 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7feba4004260 con 0x7febb4077f40 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.718+0000 7febba011640 1 -- 10.20.193.98:0/394899142 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb41a5940 con 0x7febb4077f40 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.718+0000 7febb0ff9640 1 -- 10.20.193.98:0/394899142 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7feba4004400 con 0x7febb4077f40 2026-02-20T02:27:34.722 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.718+0000 7febb0ff9640 1 -- 10.20.193.98:0/394899142 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7feba40417b0 con 0x7febb4077f40 2026-02-20T02:27:34.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.718+0000 7febba011640 1 -- 10.20.193.98:0/394899142 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb41a5e70 con 0x7febb4077f40 2026-02-20T02:27:34.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.718+0000 7febba011640 1 -- 10.20.193.98:0/394899142 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb4078d60 con 0x7febb4077f40 2026-02-20T02:27:34.723 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.719+0000 7febb0ff9640 1 -- 10.20.193.98:0/394899142 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7feba40385d0 con 0x7febb4077f40 2026-02-20T02:27:34.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.719+0000 7febb0ff9640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feb88077550 0x7feb88079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:27:34.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.719+0000 7febb0ff9640 1 -- 10.20.193.98:0/394899142 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 7336+0+0 (secure 0 0 0) 0x7feba403e070 con 0x7febb4077f40 2026-02-20T02:27:34.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.719+0000 7febb37fe640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feb88077550 0x7feb88079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:27:34.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.720+0000 7febb37fe640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feb88077550 0x7feb88079a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feba0005fd0 tx=0x7feba0005950 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:27:34.724 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.722+0000 7febb0ff9640 1 -- 10.20.193.98:0/394899142 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7feba408b400 con 0x7febb4077f40 2026-02-20T02:27:34.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:34 trial098 ceph-mon[38923]: pgmap v106: 129 pgs: 129 active+clean; 583 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-20T02:27:34.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2026-02-20T02:27:34.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2026-02-20T02:27:34.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2026-02-20T02:27:34.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2026-02-20T02:27:34.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:34 trial098 ceph-mon[38923]: osdmap e59: 8 total, 8 up, 8 in 2026-02-20T02:27:34.831 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.830+0000 7febba011640 1 -- 10.20.193.98:0/394899142 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7febb41a6120 con 0x7febb4077f40 2026-02-20T02:27:34.831 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.830+0000 7febb0ff9640 1 -- 10.20.193.98:0/394899142 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) ==== 53+0+148 (secure 0 0 0) 0x7feba40902b0 con 0x7febb4077f40 2026-02-20T02:27:34.831 INFO:teuthology.orchestra.run.trial098.stdout:name: foo, metadata pool: cephfs.foo.meta, data pools: [cephfs.foo.data ] 2026-02-20T02:27:34.832 INFO:teuthology.orchestra.run.trial098.stdout:name: bar, metadata pool: cephfs.bar.meta, data pools: [cephfs.bar.data ] 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 -- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feb88077550 msgr2=0x7feb88079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feb88077550 0x7feb88079a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feba0005fd0 tx=0x7feba0005950 comp rx=0 tx=0).stop 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 -- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 msgr2=0x7febb41a1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 0x7febb41a1320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feba402f770 tx=0x7feba402fd20 comp rx=0 tx=0).stop 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 -- 10.20.193.98:0/394899142 shutdown_connections 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7feb88077550 0x7feb88079a10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7febb4077f40 0x7febb41a1320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 --2- 10.20.193.98:0/394899142 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7febb4077620 0x7febb41a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 -- 10.20.193.98:0/394899142 >> 10.20.193.98:0/394899142 conn(0x7febb4100620 msgr2=0x7febb4101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:27:34.833 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 -- 10.20.193.98:0/394899142 shutdown_connections 2026-02-20T02:27:34.834 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:27:34.831+0000 7febba011640 1 -- 10.20.193.98:0/394899142 wait complete. 2026-02-20T02:27:34.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:34 trial106 ceph-mon[44052]: pgmap v106: 129 pgs: 129 active+clean; 583 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-20T02:27:34.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2026-02-20T02:27:34.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2026-02-20T02:27:34.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2026-02-20T02:27:34.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2026-02-20T02:27:34.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:34 trial106 ceph-mon[44052]: osdmap e59: 8 total, 8 up, 8 in 2026-02-20T02:27:34.869 INFO:tasks.cephfs.mount:Mounting Ceph FS bar; just confirmed its presence on cluster 2026-02-20T02:27:34.869 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-20T02:27:34.869 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial106.front.sepia.ceph.com 2026-02-20T02:27:34.869 INFO:tasks.cephfs.mount:self.client.name = client.1 2026-02-20T02:27:34.870 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:34.870 INFO:tasks.cephfs.mount:self.cephfs_name = bar 2026-02-20T02:27:34.870 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-20T02:27:34.870 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-20T02:27:34.870 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2026-02-20T02:27:34.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:34.870 DEBUG:teuthology.orchestra.run.trial106:> ip addr 2026-02-20T02:27:34.887 INFO:teuthology.orchestra.run.trial106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-20T02:27:34.887 INFO:teuthology.orchestra.run.trial106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-20T02:27:34.887 INFO:teuthology.orchestra.run.trial106.stdout: inet 127.0.0.1/8 scope host lo 2026-02-20T02:27:34.887 INFO:teuthology.orchestra.run.trial106.stdout: valid_lft forever preferred_lft forever 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout: inet6 ::1/128 scope host 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout: valid_lft forever preferred_lft forever 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout:2: enp7s0f4u2u2c2: mtu 1500 qdisc fq_codel state UNKNOWN group default qlen 1000 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout: link/ether a6:b0:4b:d3:39:9e brd ff:ff:ff:ff:ff:ff 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout: inet 169.254.3.1/24 brd 169.254.3.255 scope link dynamic noprefixroute enp7s0f4u2u2c2 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout: valid_lft 863519sec preferred_lft 863519sec 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout: inet6 fe80::7fae:dd47:e42f:c656/64 scope link noprefixroute 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout: valid_lft forever preferred_lft forever 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout:3: enp1s0f0: mtu 1500 qdisc mq state UP group default qlen 1000 2026-02-20T02:27:34.888 INFO:teuthology.orchestra.run.trial106.stdout: link/ether 90:5a:08:77:63:0a brd ff:ff:ff:ff:ff:ff 2026-02-20T02:27:34.889 INFO:teuthology.orchestra.run.trial106.stdout: inet 10.20.193.106/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0 2026-02-20T02:27:34.889 INFO:teuthology.orchestra.run.trial106.stdout: valid_lft 871sec preferred_lft 871sec 2026-02-20T02:27:34.889 INFO:teuthology.orchestra.run.trial106.stdout: inet6 fe80::925a:8ff:fe77:630a/64 scope link 2026-02-20T02:27:34.889 INFO:teuthology.orchestra.run.trial106.stdout: valid_lft forever preferred_lft forever 2026-02-20T02:27:34.889 INFO:teuthology.orchestra.run.trial106.stdout:4: enp1s0f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2026-02-20T02:27:34.889 INFO:teuthology.orchestra.run.trial106.stdout: link/ether 90:5a:08:77:63:0b brd ff:ff:ff:ff:ff:ff 2026-02-20T02:27:34.889 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-20T02:27:34.890 DEBUG:teuthology.orchestra.run.trial106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:34.890 DEBUG:teuthology.orchestra.run.trial106:> set -e 2026-02-20T02:27:34.890 DEBUG:teuthology.orchestra.run.trial106:> sudo ip link add name ceph-brx type bridge 2026-02-20T02:27:34.890 DEBUG:teuthology.orchestra.run.trial106:> sudo ip addr flush dev ceph-brx 2026-02-20T02:27:34.890 DEBUG:teuthology.orchestra.run.trial106:> sudo ip link set ceph-brx up 2026-02-20T02:27:34.890 DEBUG:teuthology.orchestra.run.trial106:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-20T02:27:34.890 DEBUG:teuthology.orchestra.run.trial106:> ') 2026-02-20T02:27:34.962 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:35.032 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:35.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:35.038 DEBUG:teuthology.orchestra.run.trial106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-20T02:27:35.103 INFO:teuthology.orchestra.run.trial106.stdout:1 2026-02-20T02:27:35.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:35.105 DEBUG:teuthology.orchestra.run.trial106:> ip r 2026-02-20T02:27:35.162 INFO:teuthology.orchestra.run.trial106.stdout:default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.106 metric 102 2026-02-20T02:27:35.162 INFO:teuthology.orchestra.run.trial106.stdout:10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.106 metric 102 2026-02-20T02:27:35.162 INFO:teuthology.orchestra.run.trial106.stdout:169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-20T02:27:35.162 INFO:teuthology.orchestra.run.trial106.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-20T02:27:35.163 DEBUG:teuthology.orchestra.run.trial106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:35.163 DEBUG:teuthology.orchestra.run.trial106:> set -e 2026-02-20T02:27:35.163 DEBUG:teuthology.orchestra.run.trial106:> sudo iptables -A FORWARD -o enp1s0f0 -i ceph-brx -j ACCEPT 2026-02-20T02:27:35.163 DEBUG:teuthology.orchestra.run.trial106:> sudo iptables -A FORWARD -i enp1s0f0 -o ceph-brx -j ACCEPT 2026-02-20T02:27:35.163 DEBUG:teuthology.orchestra.run.trial106:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0 -j MASQUERADE 2026-02-20T02:27:35.163 DEBUG:teuthology.orchestra.run.trial106:> ') 2026-02-20T02:27:35.236 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:35.366 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:35.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:35.371 DEBUG:teuthology.orchestra.run.trial106:> ip netns list 2026-02-20T02:27:35.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:35.428 DEBUG:teuthology.orchestra.run.trial106:> ip netns list-id 2026-02-20T02:27:35.484 DEBUG:teuthology.orchestra.run.trial106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:35.484 DEBUG:teuthology.orchestra.run.trial106:> set -e 2026-02-20T02:27:35.484 DEBUG:teuthology.orchestra.run.trial106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-20T02:27:35.484 DEBUG:teuthology.orchestra.run.trial106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2026-02-20T02:27:35.484 DEBUG:teuthology.orchestra.run.trial106:> ') 2026-02-20T02:27:35.560 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:35.582 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:35.586 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.144.1/20 2026-02-20T02:27:35.586 DEBUG:teuthology.orchestra.run.trial106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:35.586 DEBUG:teuthology.orchestra.run.trial106:> set -e 2026-02-20T02:27:35.586 DEBUG:teuthology.orchestra.run.trial106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2026-02-20T02:27:35.586 DEBUG:teuthology.orchestra.run.trial106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-20T02:27:35.586 DEBUG:teuthology.orchestra.run.trial106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2026-02-20T02:27:35.586 DEBUG:teuthology.orchestra.run.trial106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2026-02-20T02:27:35.586 DEBUG:teuthology.orchestra.run.trial106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.159.254 2026-02-20T02:27:35.587 DEBUG:teuthology.orchestra.run.trial106:> ') 2026-02-20T02:27:35.661 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:35.718 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:35.723 DEBUG:teuthology.orchestra.run.trial106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T02:27:35.723 DEBUG:teuthology.orchestra.run.trial106:> set -e 2026-02-20T02:27:35.723 DEBUG:teuthology.orchestra.run.trial106:> sudo ip link set brx.0 up 2026-02-20T02:27:35.723 DEBUG:teuthology.orchestra.run.trial106:> sudo ip link set dev brx.0 master ceph-brx 2026-02-20T02:27:35.723 DEBUG:teuthology.orchestra.run.trial106:> ') 2026-02-20T02:27:35.799 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T02:27:35.818 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:35 trial106 ceph-mon[44052]: osdmap e60: 8 total, 8 up, 8 in 2026-02-20T02:27:35.818 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:35 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/394899142' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T02:27:35.821 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:35.825 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'bar'} 2026-02-20T02:27:35.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T02:27:35.826 DEBUG:teuthology.orchestra.run.trial106:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:35.883 INFO:teuthology.orchestra.run.trial106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2026-02-20T02:27:35.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T02:27:35.884 DEBUG:teuthology.orchestra.run.trial106:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:35.940 DEBUG:teuthology.orchestra.run.trial106:> sudo modprobe fuse 2026-02-20T02:27:36.006 DEBUG:teuthology.orchestra.run.trial106:> cat /proc/self/mounts | awk '{print $2}' 2026-02-20T02:27:36.063 INFO:teuthology.orchestra.run.trial106.stdout:/proc 2026-02-20T02:27:36.063 INFO:teuthology.orchestra.run.trial106.stdout:/sys 2026-02-20T02:27:36.063 INFO:teuthology.orchestra.run.trial106.stdout:/dev 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/sys/kernel/security 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/dev/shm 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/dev/pts 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/run 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/cgroup 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/pstore 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/sys/firmware/efi/efivars 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/bpf 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/sys/kernel/config 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/ 2026-02-20T02:27:36.064 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/selinux 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/dev/hugepages 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/dev/mqueue 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/sys/kernel/debug 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/sys/kernel/tracing 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/fuse/connections 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/run/credentials/systemd-sysctl.service 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/boot/efi 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/nfs/rpc_pipefs 2026-02-20T02:27:36.065 INFO:teuthology.orchestra.run.trial106.stdout:/run/user/1000 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/ceph 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/run/user/0 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/8b8698ebc10c4b45eff24fcc7e73c3c3c4faa8abaeb9c6bc95a2d8a50091eb77/merged 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/a0694a0660e83b907ad9fde015e9567e00f4b2df43ed6c0f14014bcc9cb08e7d/merged 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/0622b0778080530bcf1cb7852929eaa4b941a67882f8e7e97ba87fbad065b42b/merged 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/93132e95783ac306d3f52d075cc3275ea9ee761adf23dce9dcd92851f6289539/merged 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/ecb2f0f08cf2fff48496c4bb69a4ab9f2ff9c623aa64b75789956005702bb504/merged 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/9cdc87bb979e3057d2033ddb9e474e56c76cf49f3795dee3c9c5a7b8e606b530/merged 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/4e0cbf28db659536c56a523fb1b06da295e4dc16bc343991f01a7d7a5f7b461f/merged 2026-02-20T02:27:36.066 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/607f3374ea9b270ccfcff1a2de80c54fb6974484206602f6ef7d5f85b8ec717f/merged 2026-02-20T02:27:36.067 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/632d910a99c08056d82bdab4a5cff5369ea3ff87c78bbe00043269ac17d1e17a/merged 2026-02-20T02:27:36.067 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/18b3c78e0ec89464f359acccfc682fbd41075638bd742158f856d1bbbfe0a344/merged 2026-02-20T02:27:36.067 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/d259cd20e370dbac05bd1e978f0e5a3250b1dcb44e9df90e92de9e5276ec21fa/merged 2026-02-20T02:27:36.067 INFO:teuthology.orchestra.run.trial106.stdout:/run/netns 2026-02-20T02:27:36.067 INFO:teuthology.orchestra.run.trial106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-20T02:27:36.067 INFO:teuthology.orchestra.run.trial106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-20T02:27:36.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:36.067 DEBUG:teuthology.orchestra.run.trial106:> ls /sys/fs/fuse/connections 2026-02-20T02:27:36.068 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:35 trial098 ceph-mon[38923]: osdmap e60: 8 total, 8 up, 8 in 2026-02-20T02:27:36.068 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:35 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/394899142' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T02:27:36.119 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2026-02-20T02:27:36.119 DEBUG:teuthology.orchestra.run.trial106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=bar) 2026-02-20T02:27:36.161 DEBUG:teuthology.orchestra.run.trial106:> sudo modprobe fuse 2026-02-20T02:27:36.187 DEBUG:teuthology.orchestra.run.trial106:> cat /proc/self/mounts | awk '{print $2}' 2026-02-20T02:27:36.241 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.trial106.stderr:2026-02-20T02:27:36.240+0000 7f9a267cd580 -1 init, newargv = 0x55fef70e75f0 newargc=15 2026-02-20T02:27:36.241 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.trial106.stderr:ceph-fuse[71518]: starting ceph client 2026-02-20T02:27:36.245 INFO:teuthology.orchestra.run.trial106.stdout:/proc 2026-02-20T02:27:36.245 INFO:teuthology.orchestra.run.trial106.stdout:/sys 2026-02-20T02:27:36.245 INFO:teuthology.orchestra.run.trial106.stdout:/dev 2026-02-20T02:27:36.245 INFO:teuthology.orchestra.run.trial106.stdout:/sys/kernel/security 2026-02-20T02:27:36.245 INFO:teuthology.orchestra.run.trial106.stdout:/dev/shm 2026-02-20T02:27:36.245 INFO:teuthology.orchestra.run.trial106.stdout:/dev/pts 2026-02-20T02:27:36.245 INFO:teuthology.orchestra.run.trial106.stdout:/run 2026-02-20T02:27:36.245 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/cgroup 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/pstore 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/sys/firmware/efi/efivars 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/bpf 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/sys/kernel/config 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/ 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/selinux 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/dev/hugepages 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/dev/mqueue 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/sys/kernel/debug 2026-02-20T02:27:36.246 INFO:teuthology.orchestra.run.trial106.stdout:/sys/kernel/tracing 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/sys/fs/fuse/connections 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/run/credentials/systemd-sysctl.service 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/boot/efi 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/nfs/rpc_pipefs 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/run/user/1000 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/ceph 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/run/user/0 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay 2026-02-20T02:27:36.247 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/8b8698ebc10c4b45eff24fcc7e73c3c3c4faa8abaeb9c6bc95a2d8a50091eb77/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/a0694a0660e83b907ad9fde015e9567e00f4b2df43ed6c0f14014bcc9cb08e7d/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/0622b0778080530bcf1cb7852929eaa4b941a67882f8e7e97ba87fbad065b42b/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/93132e95783ac306d3f52d075cc3275ea9ee761adf23dce9dcd92851f6289539/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/ecb2f0f08cf2fff48496c4bb69a4ab9f2ff9c623aa64b75789956005702bb504/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/9cdc87bb979e3057d2033ddb9e474e56c76cf49f3795dee3c9c5a7b8e606b530/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/4e0cbf28db659536c56a523fb1b06da295e4dc16bc343991f01a7d7a5f7b461f/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/607f3374ea9b270ccfcff1a2de80c54fb6974484206602f6ef7d5f85b8ec717f/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/632d910a99c08056d82bdab4a5cff5369ea3ff87c78bbe00043269ac17d1e17a/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/18b3c78e0ec89464f359acccfc682fbd41075638bd742158f856d1bbbfe0a344/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/var/lib/containers/storage/overlay/d259cd20e370dbac05bd1e978f0e5a3250b1dcb44e9df90e92de9e5276ec21fa/merged 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/run/netns 2026-02-20T02:27:36.248 INFO:teuthology.orchestra.run.trial106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-20T02:27:36.249 INFO:teuthology.orchestra.run.trial106.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-20T02:27:36.249 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.trial106.stderr:ceph-fuse[71518]: starting fuse 2026-02-20T02:27:36.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:36.250 DEBUG:teuthology.orchestra.run.trial106:> ls /sys/fs/fuse/connections 2026-02-20T02:27:36.306 INFO:teuthology.orchestra.run.trial106.stdout:46 2026-02-20T02:27:36.306 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> sudo stdin-killer -- python3 -c ' 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> import glob 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> import re 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> import os 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> import subprocess 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> def _find_admin_socket(client_name): 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> files = glob.glob(asok_path) 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> # Given a non-glob path, it better be there 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> if "*" not in asok_path: 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> assert(len(files) == 1) 2026-02-20T02:27:36.306 DEBUG:teuthology.orchestra.run.trial106:> return files[0] 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> for f in files: 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> if os.path.exists("/proc/{0}".format(pid)): 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> contents = proc_f.read() 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> if mountpoint in contents: 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> return f 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> print(_find_admin_socket("client.1")) 2026-02-20T02:27:36.307 DEBUG:teuthology.orchestra.run.trial106:> ' 2026-02-20T02:27:36.399 INFO:teuthology.orchestra.run.trial106.stdout:/var/run/ceph/ceph-client.1.71518.asok 2026-02-20T02:27:36.400 INFO:teuthology.orchestra.run.trial106.stderr:2026-02-20T02:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T02:27:36.406 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.71518.asok 2026-02-20T02:27:36.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:36.406 DEBUG:teuthology.orchestra.run.trial106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.71518.asok status 2026-02-20T02:27:36.507 INFO:teuthology.orchestra.run.trial106.stdout:{ 2026-02-20T02:27:36.507 INFO:teuthology.orchestra.run.trial106.stdout: "metadata": { 2026-02-20T02:27:36.507 INFO:teuthology.orchestra.run.trial106.stdout: "ceph_sha1": "f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03", 2026-02-20T02:27:36.507 INFO:teuthology.orchestra.run.trial106.stdout: "ceph_version": "ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable)", 2026-02-20T02:27:36.507 INFO:teuthology.orchestra.run.trial106.stdout: "entity_id": "1", 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "hostname": "trial106", 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "pid": "71518", 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "root": "/" 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "dentry_count": 0, 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "dentry_pinned_count": 0, 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "id": 24383, 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "inst": { 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "name": { 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "type": "client", 2026-02-20T02:27:36.508 INFO:teuthology.orchestra.run.trial106.stdout: "num": 24383 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "addr": { 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "192.168.144.1:0", 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 702420838 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: } 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "addr": { 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "type": "v1", 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "addr": "192.168.144.1:0", 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "nonce": 702420838 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: }, 2026-02-20T02:27:36.509 INFO:teuthology.orchestra.run.trial106.stdout: "inst_str": "client.24383 192.168.144.1:0/702420838", 2026-02-20T02:27:36.510 INFO:teuthology.orchestra.run.trial106.stdout: "addr_str": "192.168.144.1:0/702420838", 2026-02-20T02:27:36.510 INFO:teuthology.orchestra.run.trial106.stdout: "inode_count": 1, 2026-02-20T02:27:36.510 INFO:teuthology.orchestra.run.trial106.stdout: "mds_epoch": 10, 2026-02-20T02:27:36.510 INFO:teuthology.orchestra.run.trial106.stdout: "osd_epoch": 60, 2026-02-20T02:27:36.510 INFO:teuthology.orchestra.run.trial106.stdout: "osd_epoch_barrier": 0, 2026-02-20T02:27:36.510 INFO:teuthology.orchestra.run.trial106.stdout: "blocklisted": false, 2026-02-20T02:27:36.510 INFO:teuthology.orchestra.run.trial106.stdout: "fs_name": "bar" 2026-02-20T02:27:36.510 INFO:teuthology.orchestra.run.trial106.stdout:} 2026-02-20T02:27:36.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:36.513 DEBUG:teuthology.orchestra.run.trial106:> stat --file-system '--printf=%T 2026-02-20T02:27:36.513 DEBUG:teuthology.orchestra.run.trial106:> ' -- /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:36.530 INFO:teuthology.orchestra.run.trial106.stdout:fuseblk 2026-02-20T02:27:36.530 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:36.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:27:36.530 DEBUG:teuthology.orchestra.run.trial106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:36.596 INFO:teuthology.run_tasks:Running task workunit... 2026-02-20T02:27:36.625 INFO:tasks.workunit:Pulling workunits from ref f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:27:36.625 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-20T02:27:36.625 INFO:tasks.workunit:timeout=3h 2026-02-20T02:27:36.626 INFO:tasks.workunit:cleanup=True 2026-02-20T02:27:36.626 DEBUG:teuthology.orchestra.run.trial098:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:36.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T02:27:36.644 INFO:teuthology.orchestra.run.trial098.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-20T02:27:36.644 DEBUG:teuthology.orchestra.run.trial098:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:36.701 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-20T02:27:36.701 DEBUG:teuthology.orchestra.run.trial098:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-20T02:27:36.757 DEBUG:teuthology.orchestra.run.trial106:> stat -- /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:36.774 INFO:teuthology.orchestra.run.trial106.stdout: File: /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:36.775 INFO:teuthology.orchestra.run.trial106.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2026-02-20T02:27:36.775 INFO:teuthology.orchestra.run.trial106.stdout:Device: 2eh/46d Inode: 1 Links: 2 2026-02-20T02:27:36.775 INFO:teuthology.orchestra.run.trial106.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T02:27:36.775 INFO:teuthology.orchestra.run.trial106.stdout:Context: system_u:object_r:fusefs_t:s0 2026-02-20T02:27:36.775 INFO:teuthology.orchestra.run.trial106.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2026-02-20T02:27:36.775 INFO:teuthology.orchestra.run.trial106.stdout:Modify: 2026-02-20 02:27:20.527463353 +0000 2026-02-20T02:27:36.775 INFO:teuthology.orchestra.run.trial106.stdout:Change: 2026-02-20 02:27:36.593484628 +0000 2026-02-20T02:27:36.775 INFO:teuthology.orchestra.run.trial106.stdout: Birth: - 2026-02-20T02:27:36.775 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2026-02-20T02:27:36.776 DEBUG:teuthology.orchestra.run.trial106:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2026-02-20T02:27:36.837 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:36 trial106 ceph-mon[44052]: pgmap v109: 129 pgs: 129 active+clean; 583 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 2.7 KiB/s rd, 383 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:36.845 DEBUG:teuthology.orchestra.run.trial098:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:27:36.845 DEBUG:teuthology.orchestra.run.trial106:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T02:27:36.869 INFO:tasks.workunit.client.0.trial098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-20T02:27:36.907 INFO:tasks.workunit.client.1.trial106.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2026-02-20T02:27:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:36 trial098 ceph-mon[38923]: pgmap v109: 129 pgs: 129 active+clean; 583 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 2.7 KiB/s rd, 383 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:38.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:38 trial106 ceph-mon[44052]: pgmap v110: 129 pgs: 129 active+clean; 583 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:38 trial098 ceph-mon[38923]: pgmap v110: 129 pgs: 129 active+clean; 583 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:40.867 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:40 trial098 ceph-mon[38923]: pgmap v111: 129 pgs: 129 active+clean; 583 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:40.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:40 trial106 ceph-mon[44052]: pgmap v111: 129 pgs: 129 active+clean; 583 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:42.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:42 trial106 ceph-mon[44052]: pgmap v112: 129 pgs: 129 active+clean; 586 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 767 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:42 trial098 ceph-mon[38923]: pgmap v112: 129 pgs: 129 active+clean; 586 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 767 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:44.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:44 trial106 ceph-mon[44052]: pgmap v113: 129 pgs: 129 active+clean; 586 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 617 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:44 trial098 ceph-mon[38923]: pgmap v113: 129 pgs: 129 active+clean; 586 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 617 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:46.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:46 trial106 ceph-mon[44052]: pgmap v114: 129 pgs: 129 active+clean; 586 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 654 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:46 trial098 ceph-mon[38923]: pgmap v114: 129 pgs: 129 active+clean; 586 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 654 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:48.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:48 trial106 ceph-mon[44052]: pgmap v115: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 767 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:48.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:27:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:48 trial098 ceph-mon[38923]: pgmap v115: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 767 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2026-02-20T02:27:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:27:50.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:50 trial106 ceph-mon[44052]: pgmap v116: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 597 B/s wr, 0 op/s 2026-02-20T02:27:50.987 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:50 trial098 ceph-mon[38923]: pgmap v116: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 597 B/s wr, 0 op/s 2026-02-20T02:27:52.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:52 trial106 ceph-mon[44052]: pgmap v117: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 597 B/s wr, 0 op/s 2026-02-20T02:27:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:52 trial098 ceph-mon[38923]: pgmap v117: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 597 B/s wr, 0 op/s 2026-02-20T02:27:54.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:54 trial106 ceph-mon[44052]: pgmap v118: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-20T02:27:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:54 trial098 ceph-mon[38923]: pgmap v118: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-20T02:27:56.638 INFO:tasks.workunit.client.1.trial106.stderr:Note: switching to 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03'. 2026-02-20T02:27:56.638 INFO:tasks.workunit.client.1.trial106.stderr: 2026-02-20T02:27:56.638 INFO:tasks.workunit.client.1.trial106.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-20T02:27:56.638 INFO:tasks.workunit.client.1.trial106.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-20T02:27:56.638 INFO:tasks.workunit.client.1.trial106.stderr:state without impacting any branches by switching back to a branch. 2026-02-20T02:27:56.638 INFO:tasks.workunit.client.1.trial106.stderr: 2026-02-20T02:27:56.638 INFO:tasks.workunit.client.1.trial106.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-20T02:27:56.638 INFO:tasks.workunit.client.1.trial106.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr: 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr: git switch -c 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr: 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr:Or undo this operation with: 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr: 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr: git switch - 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr: 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr: 2026-02-20T02:27:56.639 INFO:tasks.workunit.client.1.trial106.stderr:HEAD is now at f4ef35d9be5 Merge PR #63023 into wip-jcollin-testing-20260218.004834-squid 2026-02-20T02:27:56.645 DEBUG:teuthology.orchestra.run.trial106:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2026-02-20T02:27:56.703 INFO:tasks.workunit.client.1.trial106.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-20T02:27:56.705 INFO:tasks.workunit.client.1.trial106.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2026-02-20T02:27:56.705 INFO:tasks.workunit.client.1.trial106.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-20T02:27:56.801 INFO:tasks.workunit.client.1.trial106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-20T02:27:56.832 INFO:tasks.workunit.client.1.trial106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-20T02:27:56.857 INFO:tasks.workunit.client.1.trial106.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2026-02-20T02:27:56.859 INFO:tasks.workunit.client.1.trial106.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2026-02-20T02:27:56.859 INFO:tasks.workunit.client.1.trial106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-20T02:27:56.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:56 trial106 ceph-mon[44052]: pgmap v119: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-20T02:27:56.876 INFO:tasks.workunit.client.0.trial098.stderr:Note: switching to 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03'. 2026-02-20T02:27:56.876 INFO:tasks.workunit.client.0.trial098.stderr: 2026-02-20T02:27:56.876 INFO:tasks.workunit.client.0.trial098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-20T02:27:56.876 INFO:tasks.workunit.client.0.trial098.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr:state without impacting any branches by switching back to a branch. 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr: 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr: 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr: git switch -c 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr: 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr:Or undo this operation with: 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr: 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr: git switch - 2026-02-20T02:27:56.877 INFO:tasks.workunit.client.0.trial098.stderr: 2026-02-20T02:27:56.878 INFO:tasks.workunit.client.0.trial098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-20T02:27:56.878 INFO:tasks.workunit.client.0.trial098.stderr: 2026-02-20T02:27:56.878 INFO:tasks.workunit.client.0.trial098.stderr:HEAD is now at f4ef35d9be5 Merge PR #63023 into wip-jcollin-testing-20260218.004834-squid 2026-02-20T02:27:56.884 DEBUG:teuthology.orchestra.run.trial098:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-20T02:27:56.885 INFO:tasks.workunit.client.1.trial106.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2026-02-20T02:27:56.889 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:27:56.889 DEBUG:teuthology.orchestra.run.trial106:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2026-02-20T02:27:56.943 INFO:tasks.workunit.client.0.trial098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-20T02:27:56.946 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.1... 2026-02-20T02:27:56.949 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2026-02-20T02:27:56.949 DEBUG:teuthology.orchestra.run.trial106:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/dbench.sh 2026-02-20T02:27:56.950 INFO:tasks.workunit.client.0.trial098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T02:27:56.950 INFO:tasks.workunit.client.0.trial098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-20T02:27:57.012 INFO:tasks.workunit.client.1.trial106.stderr:+ dbench 1 2026-02-20T02:27:57.012 INFO:tasks.workunit.client.1.trial106.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-20T02:27:57.013 INFO:tasks.workunit.client.1.trial106.stdout: 2026-02-20T02:27:57.013 INFO:tasks.workunit.client.1.trial106.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-20T02:27:57.013 INFO:tasks.workunit.client.1.trial106.stdout:0 of 1 processes prepared for launch 0 sec 2026-02-20T02:27:57.046 INFO:tasks.workunit.client.0.trial098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-20T02:27:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:56 trial098 ceph-mon[38923]: pgmap v119: 129 pgs: 129 active+clean; 588 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-20T02:27:57.078 INFO:tasks.workunit.client.0.trial098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-20T02:27:57.102 INFO:tasks.workunit.client.0.trial098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T02:27:57.104 INFO:tasks.workunit.client.0.trial098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T02:27:57.104 INFO:tasks.workunit.client.0.trial098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-20T02:27:57.113 INFO:tasks.workunit.client.1.trial106.stdout:1 of 1 processes prepared for launch 0 sec 2026-02-20T02:27:57.113 INFO:tasks.workunit.client.1.trial106.stdout:releasing clients 2026-02-20T02:27:57.127 INFO:tasks.workunit.client.0.trial098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T02:27:57.131 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:27:57.131 DEBUG:teuthology.orchestra.run.trial098:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-20T02:27:57.189 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2026-02-20T02:27:57.192 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2026-02-20T02:27:57.192 DEBUG:teuthology.orchestra.run.trial098:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2026-02-20T02:27:57.249 INFO:tasks.workunit.client.0.trial098.stderr:+ dbench 1 2026-02-20T02:27:57.250 INFO:tasks.workunit.client.0.trial098.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-20T02:27:57.250 INFO:tasks.workunit.client.0.trial098.stdout: 2026-02-20T02:27:57.250 INFO:tasks.workunit.client.0.trial098.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-20T02:27:57.251 INFO:tasks.workunit.client.0.trial098.stdout:0 of 1 processes prepared for launch 0 sec 2026-02-20T02:27:57.351 INFO:tasks.workunit.client.0.trial098.stdout:1 of 1 processes prepared for launch 0 sec 2026-02-20T02:27:57.351 INFO:tasks.workunit.client.0.trial098.stdout:releasing clients 2026-02-20T02:27:58.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 1465 26.04 MB/sec warmup 1 sec latency 7.875 ms 2026-02-20T02:27:58.351 INFO:tasks.workunit.client.0.trial098.stdout: 1 158684 870.46 MB/sec warmup 1 sec latency 9.655 ms 2026-02-20T02:27:58.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:27:58 trial106 ceph-mon[44052]: pgmap v120: 129 pgs: 129 active+clean; 3.6 MiB data, 232 MiB used, 5.5 TiB / 5.5 TiB avail; 264 KiB/s wr, 1 op/s 2026-02-20T02:27:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:27:58 trial098 ceph-mon[38923]: pgmap v120: 129 pgs: 129 active+clean; 3.6 MiB data, 232 MiB used, 5.5 TiB / 5.5 TiB avail; 264 KiB/s wr, 1 op/s 2026-02-20T02:27:59.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 2617 14.54 MB/sec warmup 2 sec latency 6.738 ms 2026-02-20T02:27:59.351 INFO:tasks.workunit.client.0.trial098.stdout: 1 317034 863.09 MB/sec warmup 2 sec latency 0.250 ms 2026-02-20T02:28:00.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 3852 13.25 MB/sec warmup 3 sec latency 7.547 ms 2026-02-20T02:28:00.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 475450 865.94 MB/sec warmup 3 sec latency 0.295 ms 2026-02-20T02:28:00.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:00 trial106 ceph-mon[44052]: pgmap v121: 129 pgs: 129 active+clean; 11 MiB data, 261 MiB used, 5.5 TiB / 5.5 TiB avail; 860 KiB/s wr, 3 op/s 2026-02-20T02:28:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:00 trial098 ceph-mon[38923]: pgmap v121: 129 pgs: 129 active+clean; 11 MiB data, 261 MiB used, 5.5 TiB / 5.5 TiB avail; 860 KiB/s wr, 3 op/s 2026-02-20T02:28:01.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 4770 10.54 MB/sec warmup 4 sec latency 8.063 ms 2026-02-20T02:28:01.351 INFO:tasks.workunit.client.0.trial098.stdout: 1 628945 856.63 MB/sec warmup 4 sec latency 14.156 ms 2026-02-20T02:28:02.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 5943 9.42 MB/sec warmup 5 sec latency 7.596 ms 2026-02-20T02:28:02.351 INFO:tasks.workunit.client.0.trial098.stdout: 1 792765 861.48 MB/sec warmup 5 sec latency 0.275 ms 2026-02-20T02:28:02.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:02 trial106 ceph-mon[44052]: pgmap v122: 129 pgs: 129 active+clean; 21 MiB data, 287 MiB used, 5.5 TiB / 5.5 TiB avail; 2.0 MiB/s wr, 35 op/s 2026-02-20T02:28:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:02 trial098 ceph-mon[38923]: pgmap v122: 129 pgs: 129 active+clean; 21 MiB data, 287 MiB used, 5.5 TiB / 5.5 TiB avail; 2.0 MiB/s wr, 35 op/s 2026-02-20T02:28:03.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 7252 9.65 MB/sec warmup 6 sec latency 7.069 ms 2026-02-20T02:28:03.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 950318 862.38 MB/sec warmup 6 sec latency 0.268 ms 2026-02-20T02:28:03.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:28:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:28:04.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 8157 8.73 MB/sec warmup 7 sec latency 7.321 ms 2026-02-20T02:28:04.351 INFO:tasks.workunit.client.0.trial098.stdout: 1 1116311 866.96 MB/sec warmup 7 sec latency 0.289 ms 2026-02-20T02:28:04.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:04 trial106 ceph-mon[44052]: pgmap v123: 129 pgs: 129 active+clean; 26 MiB data, 301 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 MiB/s wr, 49 op/s 2026-02-20T02:28:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:04 trial098 ceph-mon[38923]: pgmap v123: 129 pgs: 129 active+clean; 26 MiB data, 301 MiB used, 5.5 TiB / 5.5 TiB avail; 2.6 MiB/s wr, 49 op/s 2026-02-20T02:28:05.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 9407 8.25 MB/sec warmup 8 sec latency 6.585 ms 2026-02-20T02:28:05.351 INFO:tasks.workunit.client.0.trial098.stdout: 1 1275275 866.03 MB/sec warmup 8 sec latency 0.261 ms 2026-02-20T02:28:06.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 10653 8.52 MB/sec warmup 9 sec latency 22.025 ms 2026-02-20T02:28:06.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 1381008 834.57 MB/sec warmup 9 sec latency 69.394 ms 2026-02-20T02:28:06.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:06 trial106 ceph-mon[44052]: pgmap v124: 129 pgs: 129 active+clean; 26 MiB data, 307 MiB used, 5.5 TiB / 5.5 TiB avail; 2.0 KiB/s rd, 2.9 MiB/s wr, 60 op/s 2026-02-20T02:28:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:06 trial098 ceph-mon[38923]: pgmap v124: 129 pgs: 129 active+clean; 26 MiB data, 307 MiB used, 5.5 TiB / 5.5 TiB avail; 2.0 KiB/s rd, 2.9 MiB/s wr, 60 op/s 2026-02-20T02:28:07.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 11482 7.88 MB/sec warmup 10 sec latency 33.710 ms 2026-02-20T02:28:07.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 1541395 837.77 MB/sec warmup 10 sec latency 0.258 ms 2026-02-20T02:28:08.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 12578 7.62 MB/sec warmup 11 sec latency 7.724 ms 2026-02-20T02:28:08.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 1705001 841.98 MB/sec warmup 11 sec latency 0.234 ms 2026-02-20T02:28:08.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:08 trial106 ceph-mon[44052]: pgmap v125: 129 pgs: 129 active+clean; 28 MiB data, 312 MiB used, 5.5 TiB / 5.5 TiB avail; 2.0 KiB/s rd, 3.6 MiB/s wr, 95 op/s 2026-02-20T02:28:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:08 trial098 ceph-mon[38923]: pgmap v125: 129 pgs: 129 active+clean; 28 MiB data, 312 MiB used, 5.5 TiB / 5.5 TiB avail; 2.0 KiB/s rd, 3.6 MiB/s wr, 95 op/s 2026-02-20T02:28:09.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 13935 7.73 MB/sec warmup 12 sec latency 12.040 ms 2026-02-20T02:28:09.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 1866330 845.50 MB/sec warmup 12 sec latency 1.032 ms 2026-02-20T02:28:10.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 14699 7.50 MB/sec warmup 13 sec latency 7.588 ms 2026-02-20T02:28:10.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 2026563 846.98 MB/sec warmup 13 sec latency 0.257 ms 2026-02-20T02:28:10.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:10 trial106 ceph-mon[44052]: pgmap v126: 129 pgs: 129 active+clean; 28 MiB data, 323 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 3.6 MiB/s wr, 113 op/s 2026-02-20T02:28:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:10 trial098 ceph-mon[38923]: pgmap v126: 129 pgs: 129 active+clean; 28 MiB data, 323 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 3.6 MiB/s wr, 113 op/s 2026-02-20T02:28:11.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 15816 7.33 MB/sec warmup 14 sec latency 7.800 ms 2026-02-20T02:28:11.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 2187729 848.52 MB/sec warmup 14 sec latency 0.309 ms 2026-02-20T02:28:12.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 17109 7.33 MB/sec warmup 15 sec latency 7.568 ms 2026-02-20T02:28:12.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 2349058 851.12 MB/sec warmup 15 sec latency 0.286 ms 2026-02-20T02:28:12.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:12 trial106 ceph-mon[44052]: pgmap v127: 129 pgs: 129 active+clean; 28 MiB data, 324 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 3.5 MiB/s wr, 128 op/s 2026-02-20T02:28:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:12 trial098 ceph-mon[38923]: pgmap v127: 129 pgs: 129 active+clean; 28 MiB data, 324 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 3.5 MiB/s wr, 128 op/s 2026-02-20T02:28:13.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 18097 7.28 MB/sec warmup 16 sec latency 7.925 ms 2026-02-20T02:28:13.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 2513578 853.25 MB/sec warmup 16 sec latency 0.263 ms 2026-02-20T02:28:14.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 19132 7.15 MB/sec warmup 17 sec latency 7.618 ms 2026-02-20T02:28:14.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 2675395 854.48 MB/sec warmup 17 sec latency 2.334 ms 2026-02-20T02:28:14.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:14 trial106 ceph-mon[44052]: pgmap v128: 129 pgs: 129 active+clean; 29 MiB data, 325 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 110 op/s 2026-02-20T02:28:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:14 trial098 ceph-mon[38923]: pgmap v128: 129 pgs: 129 active+clean; 29 MiB data, 325 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 110 op/s 2026-02-20T02:28:15.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 20232 6.88 MB/sec warmup 18 sec latency 9.820 ms 2026-02-20T02:28:15.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 2838154 856.68 MB/sec warmup 18 sec latency 0.278 ms 2026-02-20T02:28:16.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 21527 7.13 MB/sec warmup 19 sec latency 7.438 ms 2026-02-20T02:28:16.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 3002678 858.26 MB/sec warmup 19 sec latency 0.241 ms 2026-02-20T02:28:16.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:16 trial106 ceph-mon[44052]: pgmap v129: 129 pgs: 129 active+clean; 30 MiB data, 332 MiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2026-02-20T02:28:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:16 trial098 ceph-mon[38923]: pgmap v129: 129 pgs: 129 active+clean; 30 MiB data, 332 MiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2026-02-20T02:28:17.113 INFO:tasks.workunit.client.1.trial106.stdout: 1 22381 6.88 MB/sec warmup 20 sec latency 7.674 ms 2026-02-20T02:28:17.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 3164492 858.98 MB/sec warmup 20 sec latency 0.250 ms 2026-02-20T02:28:18.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 23584 6.74 MB/sec warmup 21 sec latency 7.025 ms 2026-02-20T02:28:18.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 3323040 859.56 MB/sec warmup 21 sec latency 0.264 ms 2026-02-20T02:28:18.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:18 trial106 ceph-mon[44052]: pgmap v130: 129 pgs: 129 active+clean; 31 MiB data, 337 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:28:18.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:28:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:18 trial098 ceph-mon[38923]: pgmap v130: 129 pgs: 129 active+clean; 31 MiB data, 337 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:28:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:28:19.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 24846 6.96 MB/sec warmup 22 sec latency 7.782 ms 2026-02-20T02:28:19.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 3484949 860.17 MB/sec warmup 22 sec latency 0.244 ms 2026-02-20T02:28:20.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 25806 6.77 MB/sec warmup 23 sec latency 6.950 ms 2026-02-20T02:28:20.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 3645404 860.40 MB/sec warmup 23 sec latency 0.248 ms 2026-02-20T02:28:20.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:20 trial106 ceph-mon[44052]: pgmap v131: 129 pgs: 129 active+clean; 33 MiB data, 346 MiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:28:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:20 trial098 ceph-mon[38923]: pgmap v131: 129 pgs: 129 active+clean; 33 MiB data, 346 MiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:28:21.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 26971 6.69 MB/sec warmup 24 sec latency 22.619 ms 2026-02-20T02:28:21.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 3799207 859.77 MB/sec warmup 24 sec latency 33.023 ms 2026-02-20T02:28:22.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 28190 6.77 MB/sec warmup 25 sec latency 19.387 ms 2026-02-20T02:28:22.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 3954811 858.96 MB/sec warmup 25 sec latency 28.073 ms 2026-02-20T02:28:22.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:22 trial106 ceph-mon[44052]: pgmap v132: 129 pgs: 129 active+clean; 32 MiB data, 349 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 131 op/s 2026-02-20T02:28:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:22 trial098 ceph-mon[38923]: pgmap v132: 129 pgs: 129 active+clean; 32 MiB data, 349 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 131 op/s 2026-02-20T02:28:23.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 29082 6.70 MB/sec warmup 26 sec latency 6.801 ms 2026-02-20T02:28:23.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 4114961 859.09 MB/sec warmup 26 sec latency 0.234 ms 2026-02-20T02:28:23.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:23 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:28:23.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:23 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:28:23.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:23 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:28:23.868 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:23 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:28:24.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:23 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:28:24.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:23 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:28:24.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:23 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:28:24.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:23 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:28:24.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 30249 6.64 MB/sec warmup 27 sec latency 8.136 ms 2026-02-20T02:28:24.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 4271536 859.18 MB/sec warmup 27 sec latency 0.291 ms 2026-02-20T02:28:24.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:24 trial106 ceph-mon[44052]: pgmap v133: 129 pgs: 129 active+clean; 31 MiB data, 363 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-20T02:28:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:24 trial098 ceph-mon[38923]: pgmap v133: 129 pgs: 129 active+clean; 31 MiB data, 363 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-20T02:28:25.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 31624 6.69 MB/sec warmup 28 sec latency 9.303 ms 2026-02-20T02:28:25.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 4436056 860.12 MB/sec warmup 28 sec latency 0.261 ms 2026-02-20T02:28:26.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 32476 6.66 MB/sec warmup 29 sec latency 6.810 ms 2026-02-20T02:28:26.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 4596059 860.82 MB/sec warmup 29 sec latency 0.780 ms 2026-02-20T02:28:26.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:26 trial098 ceph-mon[38923]: pgmap v134: 129 pgs: 129 active+clean; 35 MiB data, 372 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.8 MiB/s wr, 151 op/s 2026-02-20T02:28:27.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 33582 6.61 MB/sec warmup 30 sec latency 20.339 ms 2026-02-20T02:28:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:26 trial106 ceph-mon[44052]: pgmap v134: 129 pgs: 129 active+clean; 35 MiB data, 372 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.8 MiB/s wr, 151 op/s 2026-02-20T02:28:27.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 4704750 851.71 MB/sec warmup 30 sec latency 68.180 ms 2026-02-20T02:28:28.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 34406 6.46 MB/sec warmup 31 sec latency 33.191 ms 2026-02-20T02:28:28.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 4802309 841.11 MB/sec warmup 31 sec latency 62.898 ms 2026-02-20T02:28:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:28 trial098 ceph-mon[38923]: pgmap v135: 129 pgs: 129 active+clean; 36 MiB data, 371 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2026-02-20T02:28:29.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 35648 6.59 MB/sec warmup 32 sec latency 7.604 ms 2026-02-20T02:28:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:28 trial106 ceph-mon[44052]: pgmap v135: 129 pgs: 129 active+clean; 36 MiB data, 371 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2026-02-20T02:28:29.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 4962053 841.75 MB/sec warmup 32 sec latency 0.248 ms 2026-02-20T02:28:30.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 36511 6.46 MB/sec warmup 33 sec latency 7.879 ms 2026-02-20T02:28:30.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 5120737 842.73 MB/sec warmup 33 sec latency 0.286 ms 2026-02-20T02:28:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:30 trial098 ceph-mon[38923]: pgmap v136: 129 pgs: 129 active+clean; 35 MiB data, 376 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.4 MiB/s wr, 125 op/s 2026-02-20T02:28:31.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 37684 6.41 MB/sec warmup 34 sec latency 7.403 ms 2026-02-20T02:28:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:30 trial106 ceph-mon[44052]: pgmap v136: 129 pgs: 129 active+clean; 35 MiB data, 376 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.4 MiB/s wr, 125 op/s 2026-02-20T02:28:31.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 5266401 841.05 MB/sec warmup 34 sec latency 35.652 ms 2026-02-20T02:28:32.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 38834 6.48 MB/sec warmup 35 sec latency 29.500 ms 2026-02-20T02:28:32.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 5425899 841.57 MB/sec warmup 35 sec latency 0.275 ms 2026-02-20T02:28:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:32 trial098 ceph-mon[38923]: pgmap v137: 129 pgs: 129 active+clean; 35 MiB data, 380 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 122 op/s 2026-02-20T02:28:33.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 39793 6.44 MB/sec warmup 36 sec latency 7.362 ms 2026-02-20T02:28:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:32 trial106 ceph-mon[44052]: pgmap v137: 129 pgs: 129 active+clean; 35 MiB data, 380 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 122 op/s 2026-02-20T02:28:33.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 5585944 842.66 MB/sec warmup 36 sec latency 1.022 ms 2026-02-20T02:28:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:28:34.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 40942 6.40 MB/sec warmup 37 sec latency 7.786 ms 2026-02-20T02:28:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:28:34.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 5749397 843.68 MB/sec warmup 37 sec latency 0.276 ms 2026-02-20T02:28:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:34 trial098 ceph-mon[38923]: pgmap v138: 129 pgs: 129 active+clean; 38 MiB data, 376 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 134 op/s 2026-02-20T02:28:35.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 42339 6.47 MB/sec warmup 38 sec latency 8.012 ms 2026-02-20T02:28:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:34 trial106 ceph-mon[44052]: pgmap v138: 129 pgs: 129 active+clean; 38 MiB data, 376 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 134 op/s 2026-02-20T02:28:35.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 5915292 845.07 MB/sec warmup 38 sec latency 0.250 ms 2026-02-20T02:28:36.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 43150 6.42 MB/sec warmup 39 sec latency 7.933 ms 2026-02-20T02:28:36.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 6071653 845.41 MB/sec warmup 39 sec latency 33.544 ms 2026-02-20T02:28:36.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:36 trial098 ceph-mon[38923]: pgmap v139: 129 pgs: 129 active+clean; 38 MiB data, 381 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-20T02:28:37.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 44200 6.39 MB/sec warmup 40 sec latency 24.981 ms 2026-02-20T02:28:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:36 trial106 ceph-mon[44052]: pgmap v139: 129 pgs: 129 active+clean; 38 MiB data, 381 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-20T02:28:37.352 INFO:tasks.workunit.client.0.trial098.stdout: 1 6236458 846.46 MB/sec warmup 40 sec latency 0.640 ms 2026-02-20T02:28:38.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 45469 6.38 MB/sec warmup 41 sec latency 6.796 ms 2026-02-20T02:28:38.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 6391914 846.29 MB/sec warmup 41 sec latency 60.470 ms 2026-02-20T02:28:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:38 trial098 ceph-mon[38923]: pgmap v140: 129 pgs: 129 active+clean; 39 MiB data, 384 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:28:39.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 46410 6.41 MB/sec warmup 42 sec latency 34.756 ms 2026-02-20T02:28:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:38 trial106 ceph-mon[44052]: pgmap v140: 129 pgs: 129 active+clean; 39 MiB data, 384 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:28:39.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 6499396 840.32 MB/sec warmup 42 sec latency 68.291 ms 2026-02-20T02:28:40.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 47312 6.32 MB/sec warmup 43 sec latency 7.791 ms 2026-02-20T02:28:40.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 6664504 841.49 MB/sec warmup 43 sec latency 0.439 ms 2026-02-20T02:28:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:40 trial098 ceph-mon[38923]: pgmap v141: 129 pgs: 129 active+clean; 40 MiB data, 403 MiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 2.5 MiB/s wr, 136 op/s 2026-02-20T02:28:41.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 48509 6.28 MB/sec warmup 44 sec latency 7.080 ms 2026-02-20T02:28:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:40 trial106 ceph-mon[44052]: pgmap v141: 129 pgs: 129 active+clean; 40 MiB data, 403 MiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 2.5 MiB/s wr, 136 op/s 2026-02-20T02:28:41.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 6827500 842.34 MB/sec warmup 44 sec latency 0.250 ms 2026-02-20T02:28:42.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 49722 6.38 MB/sec warmup 45 sec latency 7.784 ms 2026-02-20T02:28:42.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 6986800 843.08 MB/sec warmup 45 sec latency 0.357 ms 2026-02-20T02:28:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:42 trial098 ceph-mon[38923]: pgmap v142: 129 pgs: 129 active+clean; 40 MiB data, 412 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T02:28:43.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 50679 6.30 MB/sec warmup 46 sec latency 7.263 ms 2026-02-20T02:28:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:42 trial106 ceph-mon[44052]: pgmap v142: 129 pgs: 129 active+clean; 40 MiB data, 412 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T02:28:43.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 7152055 844.17 MB/sec warmup 46 sec latency 0.250 ms 2026-02-20T02:28:44.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 51790 6.26 MB/sec warmup 47 sec latency 30.104 ms 2026-02-20T02:28:44.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 7283889 841.28 MB/sec warmup 47 sec latency 56.561 ms 2026-02-20T02:28:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:44 trial098 ceph-mon[38923]: pgmap v143: 129 pgs: 129 active+clean; 41 MiB data, 416 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-20T02:28:45.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 53046 6.32 MB/sec warmup 48 sec latency 7.683 ms 2026-02-20T02:28:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:44 trial106 ceph-mon[44052]: pgmap v143: 129 pgs: 129 active+clean; 41 MiB data, 416 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-20T02:28:45.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 7440841 841.73 MB/sec warmup 48 sec latency 0.325 ms 2026-02-20T02:28:46.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 53992 6.29 MB/sec warmup 49 sec latency 7.949 ms 2026-02-20T02:28:46.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 7603066 842.46 MB/sec warmup 49 sec latency 0.286 ms 2026-02-20T02:28:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:46 trial098 ceph-mon[38923]: pgmap v144: 129 pgs: 129 active+clean; 43 MiB data, 420 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-20T02:28:47.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 55123 6.26 MB/sec warmup 50 sec latency 7.612 ms 2026-02-20T02:28:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:46 trial106 ceph-mon[44052]: pgmap v144: 129 pgs: 129 active+clean; 43 MiB data, 420 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-20T02:28:47.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 7767262 843.25 MB/sec warmup 50 sec latency 0.259 ms 2026-02-20T02:28:48.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 56515 6.32 MB/sec warmup 51 sec latency 7.935 ms 2026-02-20T02:28:48.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 7930060 844.27 MB/sec warmup 51 sec latency 0.269 ms 2026-02-20T02:28:48.919 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:48 trial106 ceph-mon[44052]: pgmap v145: 129 pgs: 129 active+clean; 43 MiB data, 426 MiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-20T02:28:48.920 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:28:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:48 trial098 ceph-mon[38923]: pgmap v145: 129 pgs: 129 active+clean; 43 MiB data, 426 MiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-20T02:28:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:28:49.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 57233 6.29 MB/sec warmup 52 sec latency 16.410 ms 2026-02-20T02:28:49.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 8090180 844.67 MB/sec warmup 52 sec latency 0.696 ms 2026-02-20T02:28:50.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 58238 6.26 MB/sec warmup 53 sec latency 33.891 ms 2026-02-20T02:28:50.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 8217533 841.69 MB/sec warmup 53 sec latency 67.891 ms 2026-02-20T02:28:51.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:50 trial098 ceph-mon[38923]: pgmap v146: 129 pgs: 129 active+clean; 44 MiB data, 419 MiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:28:51.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 59345 6.20 MB/sec warmup 54 sec latency 7.543 ms 2026-02-20T02:28:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:50 trial106 ceph-mon[44052]: pgmap v146: 129 pgs: 129 active+clean; 44 MiB data, 419 MiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:28:51.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 8378237 842.46 MB/sec warmup 54 sec latency 1.053 ms 2026-02-20T02:28:52.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 60611 6.29 MB/sec warmup 55 sec latency 7.137 ms 2026-02-20T02:28:52.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 8537673 842.77 MB/sec warmup 55 sec latency 8.141 ms 2026-02-20T02:28:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:52 trial098 ceph-mon[38923]: pgmap v147: 129 pgs: 129 active+clean; 45 MiB data, 427 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 127 op/s 2026-02-20T02:28:53.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 61505 6.22 MB/sec warmup 56 sec latency 8.815 ms 2026-02-20T02:28:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:52 trial106 ceph-mon[44052]: pgmap v147: 129 pgs: 129 active+clean; 45 MiB data, 427 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 127 op/s 2026-02-20T02:28:53.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 8699617 843.25 MB/sec warmup 56 sec latency 0.248 ms 2026-02-20T02:28:54.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 62714 6.19 MB/sec warmup 57 sec latency 7.492 ms 2026-02-20T02:28:54.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 8859317 843.88 MB/sec warmup 57 sec latency 0.290 ms 2026-02-20T02:28:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:54 trial098 ceph-mon[38923]: pgmap v148: 129 pgs: 129 active+clean; 45 MiB data, 429 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-20T02:28:55.114 INFO:tasks.workunit.client.1.trial106.stdout: 1 63902 6.27 MB/sec warmup 58 sec latency 10.280 ms 2026-02-20T02:28:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:54 trial106 ceph-mon[44052]: pgmap v148: 129 pgs: 129 active+clean; 45 MiB data, 429 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-20T02:28:55.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 9021484 844.41 MB/sec warmup 58 sec latency 0.294 ms 2026-02-20T02:28:56.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 64814 6.20 MB/sec warmup 59 sec latency 7.719 ms 2026-02-20T02:28:56.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 9182046 845.05 MB/sec warmup 59 sec latency 0.251 ms 2026-02-20T02:28:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:56 trial098 ceph-mon[38923]: pgmap v149: 129 pgs: 129 active+clean; 46 MiB data, 416 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 150 op/s 2026-02-20T02:28:57.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 65966 6.18 MB/sec warmup 60 sec latency 7.135 ms 2026-02-20T02:28:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:56 trial106 ceph-mon[44052]: pgmap v149: 129 pgs: 129 active+clean; 46 MiB data, 416 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 150 op/s 2026-02-20T02:28:57.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 9339333 845.07 MB/sec warmup 60 sec latency 20.094 ms 2026-02-20T02:28:58.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 67199 6.22 MB/sec warmup 61 sec latency 6.786 ms 2026-02-20T02:28:58.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 9501116 845.55 MB/sec warmup 61 sec latency 0.270 ms 2026-02-20T02:28:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:28:58 trial098 ceph-mon[38923]: pgmap v150: 129 pgs: 129 active+clean; 47 MiB data, 418 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 120 op/s 2026-02-20T02:28:59.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 68142 6.20 MB/sec warmup 62 sec latency 7.155 ms 2026-02-20T02:28:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:28:58 trial106 ceph-mon[44052]: pgmap v150: 129 pgs: 129 active+clean; 47 MiB data, 418 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 120 op/s 2026-02-20T02:28:59.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 9659032 845.91 MB/sec warmup 62 sec latency 0.600 ms 2026-02-20T02:29:00.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 69324 6.19 MB/sec warmup 63 sec latency 7.449 ms 2026-02-20T02:29:00.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 9821271 846.37 MB/sec warmup 63 sec latency 0.262 ms 2026-02-20T02:29:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:00 trial098 ceph-mon[38923]: pgmap v151: 129 pgs: 129 active+clean; 47 MiB data, 426 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-20T02:29:01.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 70708 6.23 MB/sec warmup 64 sec latency 7.172 ms 2026-02-20T02:29:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:00 trial106 ceph-mon[44052]: pgmap v151: 129 pgs: 129 active+clean; 47 MiB data, 426 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-20T02:29:01.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 9984388 846.89 MB/sec warmup 64 sec latency 0.257 ms 2026-02-20T02:29:02.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 71478 6.21 MB/sec warmup 65 sec latency 6.731 ms 2026-02-20T02:29:02.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 10142718 847.22 MB/sec warmup 65 sec latency 5.718 ms 2026-02-20T02:29:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:02 trial098 ceph-mon[38923]: pgmap v152: 129 pgs: 129 active+clean; 49 MiB data, 420 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T02:29:03.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 72531 6.19 MB/sec warmup 66 sec latency 8.003 ms 2026-02-20T02:29:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:02 trial106 ceph-mon[44052]: pgmap v152: 129 pgs: 129 active+clean; 49 MiB data, 420 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T02:29:03.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 10304183 847.61 MB/sec warmup 66 sec latency 0.576 ms 2026-02-20T02:29:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:29:04.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 73753 6.19 MB/sec warmup 67 sec latency 7.063 ms 2026-02-20T02:29:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:29:04.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 10466407 848.02 MB/sec warmup 67 sec latency 0.256 ms 2026-02-20T02:29:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:04 trial098 ceph-mon[38923]: pgmap v153: 129 pgs: 129 active+clean; 50 MiB data, 422 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 128 op/s 2026-02-20T02:29:05.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 74880 6.21 MB/sec warmup 68 sec latency 8.077 ms 2026-02-20T02:29:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:04 trial106 ceph-mon[44052]: pgmap v153: 129 pgs: 129 active+clean; 50 MiB data, 422 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 128 op/s 2026-02-20T02:29:05.353 INFO:tasks.workunit.client.0.trial098.stdout: 1 10625018 848.38 MB/sec warmup 68 sec latency 0.469 ms 2026-02-20T02:29:06.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 75764 6.16 MB/sec warmup 69 sec latency 26.569 ms 2026-02-20T02:29:06.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 10777245 847.95 MB/sec warmup 69 sec latency 47.119 ms 2026-02-20T02:29:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:06 trial098 ceph-mon[38923]: pgmap v154: 129 pgs: 129 active+clean; 49 MiB data, 448 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:29:07.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 76945 6.14 MB/sec warmup 70 sec latency 8.248 ms 2026-02-20T02:29:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:06 trial106 ceph-mon[44052]: pgmap v154: 129 pgs: 129 active+clean; 49 MiB data, 448 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:29:07.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 10939910 848.38 MB/sec warmup 70 sec latency 5.427 ms 2026-02-20T02:29:08.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 78233 6.20 MB/sec warmup 71 sec latency 7.302 ms 2026-02-20T02:29:08.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 11099816 848.84 MB/sec warmup 71 sec latency 0.279 ms 2026-02-20T02:29:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:08 trial098 ceph-mon[38923]: pgmap v155: 129 pgs: 129 active+clean; 52 MiB data, 472 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-20T02:29:09.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 79146 6.16 MB/sec warmup 72 sec latency 8.944 ms 2026-02-20T02:29:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:08 trial106 ceph-mon[44052]: pgmap v155: 129 pgs: 129 active+clean; 52 MiB data, 472 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-20T02:29:09.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 11263761 849.29 MB/sec warmup 72 sec latency 0.247 ms 2026-02-20T02:29:10.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 80317 6.13 MB/sec warmup 73 sec latency 7.563 ms 2026-02-20T02:29:10.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 11426288 849.69 MB/sec warmup 73 sec latency 0.243 ms 2026-02-20T02:29:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:10 trial098 ceph-mon[38923]: pgmap v156: 129 pgs: 129 active+clean; 51 MiB data, 475 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:29:11.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 81391 6.16 MB/sec warmup 74 sec latency 31.205 ms 2026-02-20T02:29:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:10 trial106 ceph-mon[44052]: pgmap v156: 129 pgs: 129 active+clean; 51 MiB data, 475 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:29:11.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 11474227 841.92 MB/sec warmup 74 sec latency 68.283 ms 2026-02-20T02:29:12.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 82185 6.14 MB/sec warmup 75 sec latency 32.676 ms 2026-02-20T02:29:12.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 11633494 842.13 MB/sec warmup 75 sec latency 25.377 ms 2026-02-20T02:29:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:12 trial098 ceph-mon[38923]: pgmap v157: 129 pgs: 129 active+clean; 52 MiB data, 482 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 150 op/s 2026-02-20T02:29:13.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 83330 6.13 MB/sec warmup 76 sec latency 6.980 ms 2026-02-20T02:29:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:12 trial106 ceph-mon[44052]: pgmap v157: 129 pgs: 129 active+clean; 52 MiB data, 482 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 150 op/s 2026-02-20T02:29:13.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 11797065 842.66 MB/sec warmup 76 sec latency 0.278 ms 2026-02-20T02:29:14.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 84611 6.15 MB/sec warmup 77 sec latency 7.566 ms 2026-02-20T02:29:14.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 11959195 843.28 MB/sec warmup 77 sec latency 0.262 ms 2026-02-20T02:29:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:14 trial098 ceph-mon[38923]: pgmap v158: 129 pgs: 129 active+clean; 53 MiB data, 483 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 118 op/s 2026-02-20T02:29:15.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 85629 6.15 MB/sec warmup 78 sec latency 7.486 ms 2026-02-20T02:29:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:14 trial106 ceph-mon[44052]: pgmap v158: 129 pgs: 129 active+clean; 53 MiB data, 483 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 118 op/s 2026-02-20T02:29:15.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 12125658 843.98 MB/sec warmup 78 sec latency 0.291 ms 2026-02-20T02:29:16.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 86737 6.14 MB/sec warmup 79 sec latency 7.935 ms 2026-02-20T02:29:16.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 12288837 844.43 MB/sec warmup 79 sec latency 0.475 ms 2026-02-20T02:29:16.987 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:16 trial098 ceph-mon[38923]: pgmap v159: 129 pgs: 129 active+clean; 52 MiB data, 490 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2026-02-20T02:29:17.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 87928 6.14 MB/sec warmup 80 sec latency 6.887 ms 2026-02-20T02:29:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:16 trial106 ceph-mon[44052]: pgmap v159: 129 pgs: 129 active+clean; 52 MiB data, 490 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2026-02-20T02:29:17.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 12448735 844.83 MB/sec warmup 80 sec latency 15.621 ms 2026-02-20T02:29:18.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 89088 6.16 MB/sec warmup 81 sec latency 7.593 ms 2026-02-20T02:29:18.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 12612433 845.32 MB/sec warmup 81 sec latency 0.255 ms 2026-02-20T02:29:18.919 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:18 trial106 ceph-mon[44052]: pgmap v160: 129 pgs: 129 active+clean; 56 MiB data, 501 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2026-02-20T02:29:18.920 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:29:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:18 trial098 ceph-mon[38923]: pgmap v160: 129 pgs: 129 active+clean; 56 MiB data, 501 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2026-02-20T02:29:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:29:19.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 90152 6.15 MB/sec warmup 82 sec latency 7.463 ms 2026-02-20T02:29:19.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 12775367 845.72 MB/sec warmup 82 sec latency 0.245 ms 2026-02-20T02:29:20.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 91306 6.11 MB/sec warmup 83 sec latency 7.401 ms 2026-02-20T02:29:20.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 12937347 846.26 MB/sec warmup 83 sec latency 0.352 ms 2026-02-20T02:29:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:20 trial098 ceph-mon[38923]: pgmap v161: 129 pgs: 129 active+clean; 55 MiB data, 510 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2026-02-20T02:29:21.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 92556 6.17 MB/sec warmup 84 sec latency 8.698 ms 2026-02-20T02:29:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:20 trial106 ceph-mon[44052]: pgmap v161: 129 pgs: 129 active+clean; 55 MiB data, 510 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2026-02-20T02:29:21.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 13099715 846.63 MB/sec warmup 84 sec latency 0.904 ms 2026-02-20T02:29:22.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 93378 6.12 MB/sec warmup 85 sec latency 35.517 ms 2026-02-20T02:29:22.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 13196082 842.77 MB/sec warmup 85 sec latency 62.419 ms 2026-02-20T02:29:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:22 trial098 ceph-mon[38923]: pgmap v162: 129 pgs: 129 active+clean; 58 MiB data, 536 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 145 op/s 2026-02-20T02:29:23.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 94575 6.10 MB/sec warmup 86 sec latency 24.282 ms 2026-02-20T02:29:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:22 trial106 ceph-mon[44052]: pgmap v162: 129 pgs: 129 active+clean; 58 MiB data, 536 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 145 op/s 2026-02-20T02:29:23.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 13356998 843.24 MB/sec warmup 86 sec latency 0.286 ms 2026-02-20T02:29:24.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:23 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:29:24.115 INFO:tasks.workunit.client.1.trial106.stdout: 1 95795 6.16 MB/sec warmup 87 sec latency 7.490 ms 2026-02-20T02:29:24.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:23 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:29:24.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 13518794 843.58 MB/sec warmup 87 sec latency 0.264 ms 2026-02-20T02:29:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:24 trial098 ceph-mon[38923]: pgmap v163: 129 pgs: 129 active+clean; 57 MiB data, 519 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-20T02:29:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:29:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:29:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:29:25.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 96681 6.11 MB/sec warmup 88 sec latency 8.983 ms 2026-02-20T02:29:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:24 trial106 ceph-mon[44052]: pgmap v163: 129 pgs: 129 active+clean; 57 MiB data, 519 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-20T02:29:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:29:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:29:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:29:25.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 13682207 844.03 MB/sec warmup 88 sec latency 0.261 ms 2026-02-20T02:29:26.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 97817 6.10 MB/sec warmup 89 sec latency 7.534 ms 2026-02-20T02:29:26.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 13841933 844.38 MB/sec warmup 89 sec latency 0.254 ms 2026-02-20T02:29:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:26 trial098 ceph-mon[38923]: pgmap v164: 129 pgs: 129 active+clean; 58 MiB data, 547 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-20T02:29:27.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 99104 6.13 MB/sec warmup 90 sec latency 8.216 ms 2026-02-20T02:29:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:26 trial106 ceph-mon[44052]: pgmap v164: 129 pgs: 129 active+clean; 58 MiB data, 547 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-20T02:29:27.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 14002528 844.64 MB/sec warmup 90 sec latency 0.245 ms 2026-02-20T02:29:28.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 99836 6.11 MB/sec warmup 91 sec latency 35.550 ms 2026-02-20T02:29:28.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 14133643 843.14 MB/sec warmup 91 sec latency 59.638 ms 2026-02-20T02:29:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:28 trial098 ceph-mon[38923]: pgmap v165: 129 pgs: 129 active+clean; 59 MiB data, 552 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.1 MiB/s wr, 145 op/s 2026-02-20T02:29:29.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 100884 6.10 MB/sec warmup 92 sec latency 7.314 ms 2026-02-20T02:29:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:28 trial106 ceph-mon[44052]: pgmap v165: 129 pgs: 129 active+clean; 59 MiB data, 552 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.1 MiB/s wr, 145 op/s 2026-02-20T02:29:29.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 14295478 843.62 MB/sec warmup 92 sec latency 0.270 ms 2026-02-20T02:29:30.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 101956 6.07 MB/sec warmup 93 sec latency 8.020 ms 2026-02-20T02:29:30.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 14457489 843.95 MB/sec warmup 93 sec latency 0.326 ms 2026-02-20T02:29:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:30 trial098 ceph-mon[38923]: pgmap v166: 129 pgs: 129 active+clean; 59 MiB data, 556 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 120 op/s 2026-02-20T02:29:31.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 103180 6.12 MB/sec warmup 94 sec latency 9.031 ms 2026-02-20T02:29:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:30 trial106 ceph-mon[44052]: pgmap v166: 129 pgs: 129 active+clean; 59 MiB data, 556 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 120 op/s 2026-02-20T02:29:31.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 14620490 844.33 MB/sec warmup 94 sec latency 0.580 ms 2026-02-20T02:29:32.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 104097 6.08 MB/sec warmup 95 sec latency 8.216 ms 2026-02-20T02:29:32.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 14779358 844.59 MB/sec warmup 95 sec latency 0.416 ms 2026-02-20T02:29:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:32 trial098 ceph-mon[38923]: pgmap v167: 129 pgs: 129 active+clean; 60 MiB data, 543 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 135 op/s 2026-02-20T02:29:33.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 105280 6.07 MB/sec warmup 96 sec latency 8.949 ms 2026-02-20T02:29:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:32 trial106 ceph-mon[44052]: pgmap v167: 129 pgs: 129 active+clean; 60 MiB data, 543 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 135 op/s 2026-02-20T02:29:33.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 14908027 843.04 MB/sec warmup 96 sec latency 57.731 ms 2026-02-20T02:29:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:29:34.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 106442 6.11 MB/sec warmup 97 sec latency 25.713 ms 2026-02-20T02:29:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:29:34.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 15071486 843.45 MB/sec warmup 97 sec latency 0.281 ms 2026-02-20T02:29:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:34 trial098 ceph-mon[38923]: pgmap v168: 129 pgs: 129 active+clean; 61 MiB data, 552 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2026-02-20T02:29:35.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 107324 6.07 MB/sec warmup 98 sec latency 8.655 ms 2026-02-20T02:29:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:34 trial106 ceph-mon[44052]: pgmap v168: 129 pgs: 129 active+clean; 61 MiB data, 552 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2026-02-20T02:29:35.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 15232252 843.86 MB/sec warmup 98 sec latency 0.282 ms 2026-02-20T02:29:36.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 108504 6.06 MB/sec warmup 99 sec latency 8.487 ms 2026-02-20T02:29:36.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 15394348 844.15 MB/sec warmup 99 sec latency 0.261 ms 2026-02-20T02:29:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:36 trial098 ceph-mon[38923]: pgmap v169: 129 pgs: 129 active+clean; 61 MiB data, 554 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 129 op/s 2026-02-20T02:29:37.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 109767 6.09 MB/sec warmup 100 sec latency 7.404 ms 2026-02-20T02:29:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:36 trial106 ceph-mon[44052]: pgmap v169: 129 pgs: 129 active+clean; 61 MiB data, 554 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 129 op/s 2026-02-20T02:29:37.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 15556446 844.44 MB/sec warmup 100 sec latency 0.241 ms 2026-02-20T02:29:38.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 110657 6.08 MB/sec warmup 101 sec latency 8.510 ms 2026-02-20T02:29:38.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 15714422 844.69 MB/sec warmup 101 sec latency 17.917 ms 2026-02-20T02:29:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:38 trial098 ceph-mon[38923]: pgmap v170: 129 pgs: 129 active+clean; 61 MiB data, 556 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 126 op/s 2026-02-20T02:29:39.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 111697 6.07 MB/sec warmup 102 sec latency 32.194 ms 2026-02-20T02:29:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:38 trial106 ceph-mon[44052]: pgmap v170: 129 pgs: 129 active+clean; 61 MiB data, 556 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 126 op/s 2026-02-20T02:29:39.354 INFO:tasks.workunit.client.0.trial098.stdout: 1 15846466 843.40 MB/sec warmup 102 sec latency 56.073 ms 2026-02-20T02:29:40.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 112973 6.08 MB/sec warmup 103 sec latency 7.745 ms 2026-02-20T02:29:40.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 16011904 843.83 MB/sec warmup 103 sec latency 0.259 ms 2026-02-20T02:29:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:40 trial098 ceph-mon[38923]: pgmap v171: 129 pgs: 129 active+clean; 64 MiB data, 562 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.5 MiB/s wr, 131 op/s 2026-02-20T02:29:41.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 113977 6.09 MB/sec warmup 104 sec latency 7.608 ms 2026-02-20T02:29:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:40 trial106 ceph-mon[44052]: pgmap v171: 129 pgs: 129 active+clean; 64 MiB data, 562 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.5 MiB/s wr, 131 op/s 2026-02-20T02:29:41.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 16172676 844.24 MB/sec warmup 104 sec latency 0.260 ms 2026-02-20T02:29:42.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 115040 6.08 MB/sec warmup 105 sec latency 7.755 ms 2026-02-20T02:29:42.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 16333081 844.45 MB/sec warmup 105 sec latency 0.925 ms 2026-02-20T02:29:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:42 trial098 ceph-mon[38923]: pgmap v172: 129 pgs: 129 active+clean; 64 MiB data, 563 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-20T02:29:43.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 116158 6.05 MB/sec warmup 106 sec latency 8.605 ms 2026-02-20T02:29:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:42 trial106 ceph-mon[44052]: pgmap v172: 129 pgs: 129 active+clean; 64 MiB data, 563 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-20T02:29:43.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 16493342 844.62 MB/sec warmup 106 sec latency 7.477 ms 2026-02-20T02:29:44.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 117402 6.09 MB/sec warmup 107 sec latency 7.988 ms 2026-02-20T02:29:44.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 16655192 845.01 MB/sec warmup 107 sec latency 0.289 ms 2026-02-20T02:29:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:44 trial098 ceph-mon[38923]: pgmap v173: 129 pgs: 129 active+clean; 66 MiB data, 567 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 138 op/s 2026-02-20T02:29:45.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 118374 6.06 MB/sec warmup 108 sec latency 9.166 ms 2026-02-20T02:29:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:44 trial106 ceph-mon[44052]: pgmap v173: 129 pgs: 129 active+clean; 66 MiB data, 567 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 138 op/s 2026-02-20T02:29:45.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 16817880 845.33 MB/sec warmup 108 sec latency 0.246 ms 2026-02-20T02:29:46.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 119533 6.05 MB/sec warmup 109 sec latency 7.455 ms 2026-02-20T02:29:46.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 16980195 845.78 MB/sec warmup 109 sec latency 0.261 ms 2026-02-20T02:29:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:46 trial098 ceph-mon[38923]: pgmap v174: 129 pgs: 129 active+clean; 67 MiB data, 580 MiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 2.6 MiB/s wr, 140 op/s 2026-02-20T02:29:47.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 120780 6.09 MB/sec warmup 110 sec latency 7.331 ms 2026-02-20T02:29:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:46 trial106 ceph-mon[44052]: pgmap v174: 129 pgs: 129 active+clean; 67 MiB data, 580 MiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 2.6 MiB/s wr, 140 op/s 2026-02-20T02:29:47.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 17144200 846.11 MB/sec warmup 110 sec latency 0.389 ms 2026-02-20T02:29:48.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 121701 6.06 MB/sec warmup 111 sec latency 8.360 ms 2026-02-20T02:29:48.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 17306188 846.36 MB/sec warmup 111 sec latency 0.259 ms 2026-02-20T02:29:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:48 trial098 ceph-mon[38923]: pgmap v175: 129 pgs: 129 active+clean; 67 MiB data, 584 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 117 op/s 2026-02-20T02:29:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:29:49.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 122955 6.05 MB/sec warmup 112 sec latency 7.311 ms 2026-02-20T02:29:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:48 trial106 ceph-mon[44052]: pgmap v175: 129 pgs: 129 active+clean; 67 MiB data, 584 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 117 op/s 2026-02-20T02:29:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:29:49.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 17467902 846.73 MB/sec warmup 112 sec latency 2.805 ms 2026-02-20T02:29:50.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 124158 6.09 MB/sec warmup 113 sec latency 7.615 ms 2026-02-20T02:29:50.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 17630295 847.01 MB/sec warmup 113 sec latency 0.240 ms 2026-02-20T02:29:51.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:50 trial098 ceph-mon[38923]: pgmap v176: 129 pgs: 129 active+clean; 68 MiB data, 592 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 144 op/s 2026-02-20T02:29:51.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 125016 6.06 MB/sec warmup 114 sec latency 8.315 ms 2026-02-20T02:29:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:50 trial106 ceph-mon[44052]: pgmap v176: 129 pgs: 129 active+clean; 68 MiB data, 592 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 144 op/s 2026-02-20T02:29:51.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 17793157 847.28 MB/sec warmup 114 sec latency 0.263 ms 2026-02-20T02:29:52.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 126193 6.05 MB/sec warmup 115 sec latency 7.795 ms 2026-02-20T02:29:52.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 17953449 847.58 MB/sec warmup 115 sec latency 0.284 ms 2026-02-20T02:29:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:52 trial098 ceph-mon[38923]: pgmap v177: 129 pgs: 129 active+clean; 69 MiB data, 604 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 127 op/s 2026-02-20T02:29:53.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 127477 6.07 MB/sec warmup 116 sec latency 10.695 ms 2026-02-20T02:29:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:52 trial106 ceph-mon[44052]: pgmap v177: 129 pgs: 129 active+clean; 69 MiB data, 604 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 127 op/s 2026-02-20T02:29:53.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 18115294 847.75 MB/sec warmup 116 sec latency 6.445 ms 2026-02-20T02:29:54.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 128310 6.06 MB/sec warmup 117 sec latency 6.760 ms 2026-02-20T02:29:54.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 18277012 847.98 MB/sec warmup 117 sec latency 0.253 ms 2026-02-20T02:29:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:54 trial098 ceph-mon[38923]: pgmap v178: 129 pgs: 129 active+clean; 69 MiB data, 582 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 135 op/s 2026-02-20T02:29:55.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 129339 6.06 MB/sec warmup 118 sec latency 40.893 ms 2026-02-20T02:29:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:54 trial106 ceph-mon[44052]: pgmap v178: 129 pgs: 129 active+clean; 69 MiB data, 582 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 135 op/s 2026-02-20T02:29:55.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 18426706 847.78 MB/sec warmup 118 sec latency 56.200 ms 2026-02-20T02:29:56.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 130525 6.05 MB/sec warmup 119 sec latency 8.733 ms 2026-02-20T02:29:56.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 18590067 848.05 MB/sec warmup 119 sec latency 0.537 ms 2026-02-20T02:29:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:56 trial098 ceph-mon[38923]: pgmap v179: 129 pgs: 129 active+clean; 70 MiB data, 589 MiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2026-02-20T02:29:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:56 trial106 ceph-mon[44052]: pgmap v179: 129 pgs: 129 active+clean; 70 MiB data, 589 MiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2026-02-20T02:29:58.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 132670 5.06 MB/sec execute 1 sec latency 7.696 ms 2026-02-20T02:29:58.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 18911785 865.60 MB/sec execute 1 sec latency 19.500 ms 2026-02-20T02:29:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:29:58 trial098 ceph-mon[38923]: pgmap v180: 129 pgs: 129 active+clean; 71 MiB data, 590 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-20T02:29:59.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 133783 3.90 MB/sec execute 2 sec latency 7.123 ms 2026-02-20T02:29:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:29:58 trial106 ceph-mon[44052]: pgmap v180: 129 pgs: 129 active+clean; 71 MiB data, 590 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-20T02:29:59.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 19076482 878.14 MB/sec execute 2 sec latency 2.921 ms 2026-02-20T02:30:00.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 134826 5.83 MB/sec execute 3 sec latency 35.537 ms 2026-02-20T02:30:00.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 19133546 687.66 MB/sec execute 3 sec latency 61.362 ms 2026-02-20T02:30:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:00 trial098 ceph-mon[38923]: pgmap v181: 129 pgs: 129 active+clean; 72 MiB data, 590 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.4 MiB/s wr, 135 op/s 2026-02-20T02:30:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:00 trial098 ceph-mon[38923]: overall HEALTH_OK 2026-02-20T02:30:01.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 135610 4.89 MB/sec execute 4 sec latency 28.363 ms 2026-02-20T02:30:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:00 trial106 ceph-mon[44052]: pgmap v181: 129 pgs: 129 active+clean; 72 MiB data, 590 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.4 MiB/s wr, 135 op/s 2026-02-20T02:30:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:00 trial106 ceph-mon[44052]: overall HEALTH_OK 2026-02-20T02:30:01.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 19283107 721.70 MB/sec execute 4 sec latency 68.069 ms 2026-02-20T02:30:02.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 136737 4.93 MB/sec execute 5 sec latency 8.094 ms 2026-02-20T02:30:02.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 19445940 753.23 MB/sec execute 5 sec latency 0.564 ms 2026-02-20T02:30:02.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:02 trial098 ceph-mon[38923]: pgmap v182: 129 pgs: 129 active+clean; 72 MiB data, 595 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 127 op/s 2026-02-20T02:30:03.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 138109 5.59 MB/sec execute 6 sec latency 7.237 ms 2026-02-20T02:30:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:02 trial106 ceph-mon[44052]: pgmap v182: 129 pgs: 129 active+clean; 72 MiB data, 595 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 127 op/s 2026-02-20T02:30:03.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 19605844 771.14 MB/sec execute 6 sec latency 5.581 ms 2026-02-20T02:30:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:30:04.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 138870 5.47 MB/sec execute 7 sec latency 7.649 ms 2026-02-20T02:30:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:30:04.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 19766191 786.91 MB/sec execute 7 sec latency 5.027 ms 2026-02-20T02:30:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:04 trial098 ceph-mon[38923]: pgmap v183: 129 pgs: 129 active+clean; 72 MiB data, 617 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.5 MiB/s wr, 118 op/s 2026-02-20T02:30:05.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 139976 5.43 MB/sec execute 8 sec latency 8.067 ms 2026-02-20T02:30:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:04 trial106 ceph-mon[44052]: pgmap v183: 129 pgs: 129 active+clean; 72 MiB data, 617 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.5 MiB/s wr, 118 op/s 2026-02-20T02:30:05.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 19929379 798.51 MB/sec execute 8 sec latency 5.027 ms 2026-02-20T02:30:06.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 141127 5.47 MB/sec execute 9 sec latency 8.727 ms 2026-02-20T02:30:06.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 20090853 806.25 MB/sec execute 9 sec latency 0.239 ms 2026-02-20T02:30:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:06 trial098 ceph-mon[38923]: pgmap v184: 129 pgs: 129 active+clean; 74 MiB data, 610 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 129 op/s 2026-02-20T02:30:07.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 142268 5.74 MB/sec execute 10 sec latency 6.575 ms 2026-02-20T02:30:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:06 trial106 ceph-mon[44052]: pgmap v184: 129 pgs: 129 active+clean; 74 MiB data, 610 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 129 op/s 2026-02-20T02:30:07.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 20252129 814.48 MB/sec execute 10 sec latency 0.261 ms 2026-02-20T02:30:08.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 143294 5.68 MB/sec execute 11 sec latency 7.874 ms 2026-02-20T02:30:08.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 20416331 820.88 MB/sec execute 11 sec latency 1.047 ms 2026-02-20T02:30:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:08 trial098 ceph-mon[38923]: pgmap v185: 129 pgs: 129 active+clean; 74 MiB data, 615 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T02:30:09.116 INFO:tasks.workunit.client.1.trial106.stdout: 1 144404 5.43 MB/sec execute 12 sec latency 6.882 ms 2026-02-20T02:30:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:08 trial106 ceph-mon[44052]: pgmap v185: 129 pgs: 129 active+clean; 74 MiB data, 615 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T02:30:09.355 INFO:tasks.workunit.client.0.trial098.stdout: 1 20579202 825.72 MB/sec execute 12 sec latency 0.233 ms 2026-02-20T02:30:10.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 145694 5.86 MB/sec execute 13 sec latency 7.737 ms 2026-02-20T02:30:10.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 20738365 829.45 MB/sec execute 13 sec latency 0.275 ms 2026-02-20T02:30:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:10 trial098 ceph-mon[38923]: pgmap v186: 129 pgs: 129 active+clean; 76 MiB data, 626 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.4 MiB/s wr, 128 op/s 2026-02-20T02:30:11.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 146634 5.61 MB/sec execute 14 sec latency 8.086 ms 2026-02-20T02:30:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:10 trial106 ceph-mon[44052]: pgmap v186: 129 pgs: 129 active+clean; 76 MiB data, 626 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.4 MiB/s wr, 128 op/s 2026-02-20T02:30:11.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 20903097 833.63 MB/sec execute 14 sec latency 0.253 ms 2026-02-20T02:30:12.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 147835 5.56 MB/sec execute 15 sec latency 6.895 ms 2026-02-20T02:30:12.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 21066926 836.98 MB/sec execute 15 sec latency 0.269 ms 2026-02-20T02:30:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:12 trial098 ceph-mon[38923]: pgmap v187: 129 pgs: 129 active+clean; 75 MiB data, 628 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:30:13.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 149088 5.89 MB/sec execute 16 sec latency 7.185 ms 2026-02-20T02:30:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:12 trial106 ceph-mon[44052]: pgmap v187: 129 pgs: 129 active+clean; 75 MiB data, 628 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:30:13.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 21228300 839.96 MB/sec execute 16 sec latency 0.278 ms 2026-02-20T02:30:14.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 149981 5.68 MB/sec execute 17 sec latency 6.636 ms 2026-02-20T02:30:14.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 21393178 842.96 MB/sec execute 17 sec latency 0.270 ms 2026-02-20T02:30:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:14 trial098 ceph-mon[38923]: pgmap v188: 129 pgs: 129 active+clean; 76 MiB data, 642 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 112 op/s 2026-02-20T02:30:15.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 151114 5.63 MB/sec execute 18 sec latency 7.144 ms 2026-02-20T02:30:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:14 trial106 ceph-mon[44052]: pgmap v188: 129 pgs: 129 active+clean; 76 MiB data, 642 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 112 op/s 2026-02-20T02:30:15.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 21557287 846.20 MB/sec execute 18 sec latency 0.258 ms 2026-02-20T02:30:16.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 152337 5.79 MB/sec execute 19 sec latency 7.470 ms 2026-02-20T02:30:16.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 21719008 847.58 MB/sec execute 19 sec latency 0.258 ms 2026-02-20T02:30:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:16 trial098 ceph-mon[38923]: pgmap v189: 129 pgs: 129 active+clean; 79 MiB data, 644 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 138 op/s 2026-02-20T02:30:17.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 153329 5.76 MB/sec execute 20 sec latency 7.939 ms 2026-02-20T02:30:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:16 trial106 ceph-mon[44052]: pgmap v189: 129 pgs: 129 active+clean; 79 MiB data, 644 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 138 op/s 2026-02-20T02:30:17.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 21878876 848.31 MB/sec execute 20 sec latency 0.243 ms 2026-02-20T02:30:18.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 154454 5.72 MB/sec execute 21 sec latency 7.841 ms 2026-02-20T02:30:18.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 22039392 849.91 MB/sec execute 21 sec latency 0.299 ms 2026-02-20T02:30:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:18 trial098 ceph-mon[38923]: pgmap v190: 129 pgs: 129 active+clean; 78 MiB data, 629 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 121 op/s 2026-02-20T02:30:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:30:19.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 155825 5.87 MB/sec execute 22 sec latency 7.548 ms 2026-02-20T02:30:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:18 trial106 ceph-mon[44052]: pgmap v190: 129 pgs: 129 active+clean; 78 MiB data, 629 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 121 op/s 2026-02-20T02:30:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:30:19.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 22199233 850.53 MB/sec execute 22 sec latency 13.337 ms 2026-02-20T02:30:20.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 156601 5.82 MB/sec execute 23 sec latency 7.767 ms 2026-02-20T02:30:20.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 22365288 852.41 MB/sec execute 23 sec latency 0.258 ms 2026-02-20T02:30:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:20 trial098 ceph-mon[38923]: pgmap v191: 129 pgs: 129 active+clean; 80 MiB data, 640 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 147 op/s 2026-02-20T02:30:21.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 157685 5.79 MB/sec execute 24 sec latency 7.998 ms 2026-02-20T02:30:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:20 trial106 ceph-mon[44052]: pgmap v191: 129 pgs: 129 active+clean; 80 MiB data, 640 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 147 op/s 2026-02-20T02:30:21.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 22516523 851.54 MB/sec execute 24 sec latency 53.808 ms 2026-02-20T02:30:22.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 158810 5.79 MB/sec execute 25 sec latency 21.409 ms 2026-02-20T02:30:22.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 22681894 853.15 MB/sec execute 25 sec latency 0.242 ms 2026-02-20T02:30:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:22 trial098 ceph-mon[38923]: pgmap v192: 129 pgs: 129 active+clean; 80 MiB data, 639 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2026-02-20T02:30:23.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 159961 5.87 MB/sec execute 26 sec latency 7.600 ms 2026-02-20T02:30:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:22 trial106 ceph-mon[44052]: pgmap v192: 129 pgs: 129 active+clean; 80 MiB data, 639 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2026-02-20T02:30:23.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 22846416 854.44 MB/sec execute 26 sec latency 0.419 ms 2026-02-20T02:30:24.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 160897 5.75 MB/sec execute 27 sec latency 7.934 ms 2026-02-20T02:30:24.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 23007843 855.63 MB/sec execute 27 sec latency 2.650 ms 2026-02-20T02:30:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:24 trial098 ceph-mon[38923]: pgmap v193: 129 pgs: 129 active+clean; 79 MiB data, 664 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-20T02:30:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:30:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:30:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:30:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:30:25.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 162041 5.71 MB/sec execute 28 sec latency 8.077 ms 2026-02-20T02:30:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:24 trial106 ceph-mon[44052]: pgmap v193: 129 pgs: 129 active+clean; 79 MiB data, 664 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-20T02:30:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:30:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:30:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:30:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:30:25.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 23173439 856.99 MB/sec execute 28 sec latency 0.273 ms 2026-02-20T02:30:26.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 163271 5.88 MB/sec execute 29 sec latency 7.535 ms 2026-02-20T02:30:26.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 23328474 856.27 MB/sec execute 29 sec latency 18.853 ms 2026-02-20T02:30:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:26 trial098 ceph-mon[38923]: pgmap v194: 129 pgs: 129 active+clean; 82 MiB data, 671 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.8 MiB/s wr, 154 op/s 2026-02-20T02:30:27.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 163778 5.74 MB/sec execute 30 sec latency 31.795 ms 2026-02-20T02:30:27.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:26 trial106 ceph-mon[44052]: pgmap v194: 129 pgs: 129 active+clean; 82 MiB data, 671 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.8 MiB/s wr, 154 op/s 2026-02-20T02:30:27.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 23351606 831.88 MB/sec execute 30 sec latency 62.576 ms 2026-02-20T02:30:28.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 164832 5.72 MB/sec execute 31 sec latency 32.015 ms 2026-02-20T02:30:28.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 23511834 833.49 MB/sec execute 31 sec latency 0.703 ms 2026-02-20T02:30:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:28 trial098 ceph-mon[38923]: pgmap v195: 129 pgs: 129 active+clean; 82 MiB data, 673 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2026-02-20T02:30:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:28 trial106 ceph-mon[44052]: pgmap v195: 129 pgs: 129 active+clean; 82 MiB data, 673 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2026-02-20T02:30:29.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 165962 5.72 MB/sec execute 32 sec latency 7.274 ms 2026-02-20T02:30:29.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 23676848 835.22 MB/sec execute 32 sec latency 0.228 ms 2026-02-20T02:30:30.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 167038 5.79 MB/sec execute 33 sec latency 7.401 ms 2026-02-20T02:30:30.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 23839469 836.94 MB/sec execute 33 sec latency 0.875 ms 2026-02-20T02:30:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:30 trial098 ceph-mon[38923]: pgmap v196: 129 pgs: 129 active+clean; 82 MiB data, 673 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.4 MiB/s wr, 125 op/s 2026-02-20T02:30:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:30 trial106 ceph-mon[44052]: pgmap v196: 129 pgs: 129 active+clean; 82 MiB data, 673 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.4 MiB/s wr, 125 op/s 2026-02-20T02:30:31.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 167954 5.69 MB/sec execute 34 sec latency 7.702 ms 2026-02-20T02:30:31.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 24001827 838.09 MB/sec execute 34 sec latency 0.236 ms 2026-02-20T02:30:32.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 169128 5.66 MB/sec execute 35 sec latency 7.621 ms 2026-02-20T02:30:32.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 24162221 838.83 MB/sec execute 35 sec latency 0.352 ms 2026-02-20T02:30:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:32 trial098 ceph-mon[38923]: pgmap v197: 129 pgs: 129 active+clean; 82 MiB data, 678 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 122 op/s 2026-02-20T02:30:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:32 trial106 ceph-mon[44052]: pgmap v197: 129 pgs: 129 active+clean; 82 MiB data, 678 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 122 op/s 2026-02-20T02:30:33.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 170281 5.80 MB/sec execute 36 sec latency 36.186 ms 2026-02-20T02:30:33.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 24292215 835.04 MB/sec execute 36 sec latency 64.891 ms 2026-02-20T02:30:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:30:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:30:34.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 171210 5.71 MB/sec execute 37 sec latency 8.115 ms 2026-02-20T02:30:34.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 24452795 836.31 MB/sec execute 37 sec latency 4.412 ms 2026-02-20T02:30:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:34 trial098 ceph-mon[38923]: pgmap v198: 129 pgs: 129 active+clean; 83 MiB data, 671 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:30:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:34 trial106 ceph-mon[44052]: pgmap v198: 129 pgs: 129 active+clean; 83 MiB data, 671 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:30:35.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 172355 5.68 MB/sec execute 38 sec latency 7.872 ms 2026-02-20T02:30:35.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 24615509 837.43 MB/sec execute 38 sec latency 9.724 ms 2026-02-20T02:30:36.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 173599 5.76 MB/sec execute 39 sec latency 7.852 ms 2026-02-20T02:30:36.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 24778365 838.89 MB/sec execute 39 sec latency 0.389 ms 2026-02-20T02:30:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:36 trial098 ceph-mon[38923]: pgmap v199: 129 pgs: 129 active+clean; 86 MiB data, 693 MiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.6 MiB/s wr, 136 op/s 2026-02-20T02:30:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:36 trial106 ceph-mon[44052]: pgmap v199: 129 pgs: 129 active+clean; 86 MiB data, 693 MiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.6 MiB/s wr, 136 op/s 2026-02-20T02:30:37.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 174520 5.74 MB/sec execute 40 sec latency 8.068 ms 2026-02-20T02:30:37.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 24940588 839.73 MB/sec execute 40 sec latency 0.249 ms 2026-02-20T02:30:38.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 175668 5.73 MB/sec execute 41 sec latency 7.004 ms 2026-02-20T02:30:38.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 25071210 836.50 MB/sec execute 41 sec latency 66.246 ms 2026-02-20T02:30:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:38 trial098 ceph-mon[38923]: pgmap v200: 129 pgs: 129 active+clean; 86 MiB data, 699 MiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.7 MiB/s wr, 107 op/s 2026-02-20T02:30:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:38 trial106 ceph-mon[44052]: pgmap v200: 129 pgs: 129 active+clean; 86 MiB data, 699 MiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.7 MiB/s wr, 107 op/s 2026-02-20T02:30:39.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 176834 5.76 MB/sec execute 42 sec latency 31.213 ms 2026-02-20T02:30:39.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 25234850 837.95 MB/sec execute 42 sec latency 0.269 ms 2026-02-20T02:30:40.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 177806 5.78 MB/sec execute 43 sec latency 7.603 ms 2026-02-20T02:30:40.356 INFO:tasks.workunit.client.0.trial098.stdout: 1 25398177 838.93 MB/sec execute 43 sec latency 0.256 ms 2026-02-20T02:30:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:40 trial098 ceph-mon[38923]: pgmap v201: 129 pgs: 129 active+clean; 88 MiB data, 694 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 133 op/s 2026-02-20T02:30:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:40 trial106 ceph-mon[44052]: pgmap v201: 129 pgs: 129 active+clean; 88 MiB data, 694 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 133 op/s 2026-02-20T02:30:41.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 178898 5.77 MB/sec execute 44 sec latency 8.888 ms 2026-02-20T02:30:41.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 25559899 839.70 MB/sec execute 44 sec latency 0.245 ms 2026-02-20T02:30:42.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 180113 5.77 MB/sec execute 45 sec latency 7.732 ms 2026-02-20T02:30:42.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 25719873 840.59 MB/sec execute 45 sec latency 0.283 ms 2026-02-20T02:30:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:42 trial098 ceph-mon[38923]: pgmap v202: 129 pgs: 129 active+clean; 88 MiB data, 693 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-20T02:30:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:42 trial106 ceph-mon[44052]: pgmap v202: 129 pgs: 129 active+clean; 88 MiB data, 693 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-20T02:30:43.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 181268 5.82 MB/sec execute 46 sec latency 6.786 ms 2026-02-20T02:30:43.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 25884145 841.58 MB/sec execute 46 sec latency 0.266 ms 2026-02-20T02:30:44.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 182112 5.74 MB/sec execute 47 sec latency 29.807 ms 2026-02-20T02:30:44.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 26012326 838.34 MB/sec execute 47 sec latency 57.161 ms 2026-02-20T02:30:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:44 trial098 ceph-mon[38923]: pgmap v203: 129 pgs: 129 active+clean; 88 MiB data, 697 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 121 op/s 2026-02-20T02:30:45.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:44 trial106 ceph-mon[44052]: pgmap v203: 129 pgs: 129 active+clean; 88 MiB data, 697 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 121 op/s 2026-02-20T02:30:45.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 183302 5.72 MB/sec execute 48 sec latency 6.771 ms 2026-02-20T02:30:45.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 26174233 839.39 MB/sec execute 48 sec latency 0.263 ms 2026-02-20T02:30:46.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 184564 5.83 MB/sec execute 49 sec latency 7.265 ms 2026-02-20T02:30:46.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 26339947 840.54 MB/sec execute 49 sec latency 0.254 ms 2026-02-20T02:30:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:46 trial098 ceph-mon[38923]: pgmap v204: 129 pgs: 129 active+clean; 89 MiB data, 690 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 134 op/s 2026-02-20T02:30:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:46 trial106 ceph-mon[44052]: pgmap v204: 129 pgs: 129 active+clean; 89 MiB data, 690 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 134 op/s 2026-02-20T02:30:47.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 185435 5.75 MB/sec execute 50 sec latency 8.633 ms 2026-02-20T02:30:47.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 26503197 841.33 MB/sec execute 50 sec latency 0.259 ms 2026-02-20T02:30:48.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 186599 5.74 MB/sec execute 51 sec latency 8.757 ms 2026-02-20T02:30:48.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 26665301 842.30 MB/sec execute 51 sec latency 0.285 ms 2026-02-20T02:30:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:48 trial098 ceph-mon[38923]: pgmap v205: 129 pgs: 129 active+clean; 89 MiB data, 690 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 116 op/s 2026-02-20T02:30:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:30:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:48 trial106 ceph-mon[44052]: pgmap v205: 129 pgs: 129 active+clean; 89 MiB data, 690 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 116 op/s 2026-02-20T02:30:49.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:30:49.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 187789 5.79 MB/sec execute 52 sec latency 7.757 ms 2026-02-20T02:30:49.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 26826074 842.76 MB/sec execute 52 sec latency 0.257 ms 2026-02-20T02:30:50.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 188788 5.78 MB/sec execute 53 sec latency 8.576 ms 2026-02-20T02:30:50.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 26985449 843.08 MB/sec execute 53 sec latency 12.321 ms 2026-02-20T02:30:51.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:50 trial098 ceph-mon[38923]: pgmap v206: 129 pgs: 129 active+clean; 91 MiB data, 706 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.5 MiB/s wr, 140 op/s 2026-02-20T02:30:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:50 trial106 ceph-mon[44052]: pgmap v206: 129 pgs: 129 active+clean; 91 MiB data, 706 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.5 MiB/s wr, 140 op/s 2026-02-20T02:30:51.117 INFO:tasks.workunit.client.1.trial106.stdout: 1 189910 5.77 MB/sec execute 54 sec latency 7.677 ms 2026-02-20T02:30:51.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 27149468 844.15 MB/sec execute 54 sec latency 12.321 ms 2026-02-20T02:30:52.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 191289 5.82 MB/sec execute 55 sec latency 7.875 ms 2026-02-20T02:30:52.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 27312231 844.79 MB/sec execute 55 sec latency 0.266 ms 2026-02-20T02:30:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:52 trial098 ceph-mon[38923]: pgmap v207: 129 pgs: 129 active+clean; 92 MiB data, 711 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:30:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:52 trial106 ceph-mon[44052]: pgmap v207: 129 pgs: 129 active+clean; 92 MiB data, 711 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:30:53.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 192076 5.80 MB/sec execute 56 sec latency 6.832 ms 2026-02-20T02:30:53.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 27476287 845.45 MB/sec execute 56 sec latency 0.594 ms 2026-02-20T02:30:54.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 193187 5.79 MB/sec execute 57 sec latency 9.104 ms 2026-02-20T02:30:54.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 27637714 846.15 MB/sec execute 57 sec latency 0.273 ms 2026-02-20T02:30:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:54 trial098 ceph-mon[38923]: pgmap v208: 129 pgs: 129 active+clean; 93 MiB data, 715 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2026-02-20T02:30:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:54 trial106 ceph-mon[44052]: pgmap v208: 129 pgs: 129 active+clean; 93 MiB data, 715 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2026-02-20T02:30:55.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 194463 5.82 MB/sec execute 58 sec latency 7.738 ms 2026-02-20T02:30:55.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 27795530 846.30 MB/sec execute 58 sec latency 14.247 ms 2026-02-20T02:30:56.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 195500 5.83 MB/sec execute 59 sec latency 7.812 ms 2026-02-20T02:30:56.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 27958817 846.86 MB/sec execute 59 sec latency 0.305 ms 2026-02-20T02:30:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:56 trial098 ceph-mon[38923]: pgmap v209: 129 pgs: 129 active+clean; 93 MiB data, 721 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 139 op/s 2026-02-20T02:30:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:56 trial106 ceph-mon[44052]: pgmap v209: 129 pgs: 129 active+clean; 93 MiB data, 721 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 139 op/s 2026-02-20T02:30:57.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 196564 5.82 MB/sec execute 60 sec latency 8.717 ms 2026-02-20T02:30:57.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 28120111 847.53 MB/sec execute 60 sec latency 0.543 ms 2026-02-20T02:30:58.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 197657 5.77 MB/sec execute 61 sec latency 7.905 ms 2026-02-20T02:30:58.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 28284973 848.19 MB/sec execute 61 sec latency 0.261 ms 2026-02-20T02:30:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:30:58 trial098 ceph-mon[38923]: pgmap v210: 129 pgs: 129 active+clean; 92 MiB data, 729 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 124 op/s 2026-02-20T02:30:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:30:58 trial106 ceph-mon[44052]: pgmap v210: 129 pgs: 129 active+clean; 92 MiB data, 729 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 124 op/s 2026-02-20T02:30:59.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 198860 5.85 MB/sec execute 62 sec latency 6.857 ms 2026-02-20T02:30:59.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 28444504 848.63 MB/sec execute 62 sec latency 0.715 ms 2026-02-20T02:31:00.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 199747 5.80 MB/sec execute 63 sec latency 8.130 ms 2026-02-20T02:31:00.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 28600381 848.49 MB/sec execute 63 sec latency 23.641 ms 2026-02-20T02:31:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:00 trial098 ceph-mon[38923]: pgmap v211: 129 pgs: 129 active+clean; 95 MiB data, 743 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2026-02-20T02:31:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:00 trial106 ceph-mon[44052]: pgmap v211: 129 pgs: 129 active+clean; 95 MiB data, 743 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2026-02-20T02:31:01.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 200976 5.78 MB/sec execute 64 sec latency 7.349 ms 2026-02-20T02:31:01.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 28762130 848.90 MB/sec execute 64 sec latency 0.283 ms 2026-02-20T02:31:02.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 202205 5.86 MB/sec execute 65 sec latency 7.440 ms 2026-02-20T02:31:02.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 28923903 849.48 MB/sec execute 65 sec latency 0.255 ms 2026-02-20T02:31:03.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:02 trial098 ceph-mon[38923]: pgmap v212: 129 pgs: 129 active+clean; 95 MiB data, 748 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2026-02-20T02:31:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:02 trial106 ceph-mon[44052]: pgmap v212: 129 pgs: 129 active+clean; 95 MiB data, 748 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2026-02-20T02:31:03.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 203125 5.81 MB/sec execute 66 sec latency 7.688 ms 2026-02-20T02:31:03.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 29088772 850.14 MB/sec execute 66 sec latency 0.271 ms 2026-02-20T02:31:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:31:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:31:04.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 204282 5.79 MB/sec execute 67 sec latency 7.779 ms 2026-02-20T02:31:04.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 29253410 850.66 MB/sec execute 67 sec latency 0.229 ms 2026-02-20T02:31:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:04 trial098 ceph-mon[38923]: pgmap v213: 129 pgs: 129 active+clean; 94 MiB data, 790 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2026-02-20T02:31:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:04 trial106 ceph-mon[44052]: pgmap v213: 129 pgs: 129 active+clean; 94 MiB data, 790 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2026-02-20T02:31:05.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 205467 5.84 MB/sec execute 68 sec latency 33.310 ms 2026-02-20T02:31:05.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 29312673 842.86 MB/sec execute 68 sec latency 69.674 ms 2026-02-20T02:31:06.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 206135 5.82 MB/sec execute 69 sec latency 34.372 ms 2026-02-20T02:31:06.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 29454302 841.95 MB/sec execute 69 sec latency 51.214 ms 2026-02-20T02:31:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:06 trial098 ceph-mon[38923]: pgmap v214: 129 pgs: 129 active+clean; 98 MiB data, 793 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:31:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:06 trial106 ceph-mon[44052]: pgmap v214: 129 pgs: 129 active+clean; 98 MiB data, 793 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:31:07.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 207204 5.81 MB/sec execute 70 sec latency 7.686 ms 2026-02-20T02:31:07.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 29612994 842.11 MB/sec execute 70 sec latency 0.266 ms 2026-02-20T02:31:08.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 208310 5.77 MB/sec execute 71 sec latency 8.116 ms 2026-02-20T02:31:08.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 29779228 842.90 MB/sec execute 71 sec latency 0.283 ms 2026-02-20T02:31:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:08 trial098 ceph-mon[38923]: pgmap v215: 129 pgs: 129 active+clean; 97 MiB data, 778 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 118 op/s 2026-02-20T02:31:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:08 trial106 ceph-mon[44052]: pgmap v215: 129 pgs: 129 active+clean; 97 MiB data, 778 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 118 op/s 2026-02-20T02:31:09.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 209561 5.84 MB/sec execute 72 sec latency 6.752 ms 2026-02-20T02:31:09.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 29939351 843.43 MB/sec execute 72 sec latency 0.284 ms 2026-02-20T02:31:10.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 210462 5.79 MB/sec execute 73 sec latency 7.780 ms 2026-02-20T02:31:10.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 30099329 843.67 MB/sec execute 73 sec latency 10.052 ms 2026-02-20T02:31:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:10 trial098 ceph-mon[38923]: pgmap v216: 129 pgs: 129 active+clean; 100 MiB data, 809 MiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 139 op/s 2026-02-20T02:31:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:10 trial106 ceph-mon[44052]: pgmap v216: 129 pgs: 129 active+clean; 100 MiB data, 809 MiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 139 op/s 2026-02-20T02:31:11.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 211674 5.78 MB/sec execute 74 sec latency 7.103 ms 2026-02-20T02:31:11.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 30261295 844.35 MB/sec execute 74 sec latency 2.346 ms 2026-02-20T02:31:12.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 212930 5.85 MB/sec execute 75 sec latency 7.707 ms 2026-02-20T02:31:12.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 30422052 844.61 MB/sec execute 75 sec latency 0.310 ms 2026-02-20T02:31:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:12 trial098 ceph-mon[38923]: pgmap v217: 129 pgs: 129 active+clean; 99 MiB data, 807 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:31:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:12 trial106 ceph-mon[44052]: pgmap v217: 129 pgs: 129 active+clean; 99 MiB data, 807 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:31:13.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 213808 5.80 MB/sec execute 76 sec latency 8.237 ms 2026-02-20T02:31:13.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 30581512 844.81 MB/sec execute 76 sec latency 0.280 ms 2026-02-20T02:31:14.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 215053 5.79 MB/sec execute 77 sec latency 7.213 ms 2026-02-20T02:31:14.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 30740229 845.17 MB/sec execute 77 sec latency 0.283 ms 2026-02-20T02:31:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:14 trial098 ceph-mon[38923]: pgmap v218: 129 pgs: 129 active+clean; 100 MiB data, 812 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 119 op/s 2026-02-20T02:31:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:14 trial106 ceph-mon[44052]: pgmap v218: 129 pgs: 129 active+clean; 100 MiB data, 812 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 119 op/s 2026-02-20T02:31:15.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 216231 5.82 MB/sec execute 78 sec latency 7.424 ms 2026-02-20T02:31:15.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 30902921 845.56 MB/sec execute 78 sec latency 0.310 ms 2026-02-20T02:31:16.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 217172 5.81 MB/sec execute 79 sec latency 28.774 ms 2026-02-20T02:31:16.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 31006805 841.97 MB/sec execute 79 sec latency 59.119 ms 2026-02-20T02:31:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:16 trial098 ceph-mon[38923]: pgmap v219: 129 pgs: 129 active+clean; 100 MiB data, 815 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T02:31:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:16 trial106 ceph-mon[44052]: pgmap v219: 129 pgs: 129 active+clean; 100 MiB data, 815 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T02:31:17.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 218251 5.80 MB/sec execute 80 sec latency 34.105 ms 2026-02-20T02:31:17.357 INFO:tasks.workunit.client.0.trial098.stdout: 1 31164012 842.03 MB/sec execute 80 sec latency 50.005 ms 2026-02-20T02:31:18.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 219593 5.83 MB/sec execute 81 sec latency 7.606 ms 2026-02-20T02:31:18.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 31323135 842.44 MB/sec execute 81 sec latency 0.269 ms 2026-02-20T02:31:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:18 trial098 ceph-mon[38923]: pgmap v220: 129 pgs: 129 active+clean; 102 MiB data, 821 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:31:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:31:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:18 trial106 ceph-mon[44052]: pgmap v220: 129 pgs: 129 active+clean; 102 MiB data, 821 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:31:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:31:19.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 220466 5.83 MB/sec execute 82 sec latency 6.617 ms 2026-02-20T02:31:19.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 31483660 842.73 MB/sec execute 82 sec latency 0.262 ms 2026-02-20T02:31:20.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 221568 5.82 MB/sec execute 83 sec latency 7.629 ms 2026-02-20T02:31:20.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 31644025 843.20 MB/sec execute 83 sec latency 0.275 ms 2026-02-20T02:31:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:20 trial098 ceph-mon[38923]: pgmap v221: 129 pgs: 129 active+clean; 102 MiB data, 825 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.5 MiB/s wr, 132 op/s 2026-02-20T02:31:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:20 trial106 ceph-mon[44052]: pgmap v221: 129 pgs: 129 active+clean; 102 MiB data, 825 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.5 MiB/s wr, 132 op/s 2026-02-20T02:31:21.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 222858 5.83 MB/sec execute 84 sec latency 8.163 ms 2026-02-20T02:31:21.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 31805028 843.47 MB/sec execute 84 sec latency 3.254 ms 2026-02-20T02:31:22.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 223906 5.85 MB/sec execute 85 sec latency 7.593 ms 2026-02-20T02:31:22.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 31966680 843.83 MB/sec execute 85 sec latency 0.269 ms 2026-02-20T02:31:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:22 trial098 ceph-mon[38923]: pgmap v222: 129 pgs: 129 active+clean; 102 MiB data, 833 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 112 op/s 2026-02-20T02:31:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:22 trial106 ceph-mon[44052]: pgmap v222: 129 pgs: 129 active+clean; 102 MiB data, 833 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 112 op/s 2026-02-20T02:31:23.118 INFO:tasks.workunit.client.1.trial106.stdout: 1 224961 5.84 MB/sec execute 86 sec latency 7.974 ms 2026-02-20T02:31:23.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 32124685 844.11 MB/sec execute 86 sec latency 0.279 ms 2026-02-20T02:31:24.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 226079 5.81 MB/sec execute 87 sec latency 7.821 ms 2026-02-20T02:31:24.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 32286264 844.44 MB/sec execute 87 sec latency 0.249 ms 2026-02-20T02:31:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:24 trial098 ceph-mon[38923]: pgmap v223: 129 pgs: 129 active+clean; 104 MiB data, 884 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 138 op/s 2026-02-20T02:31:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:31:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:31:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:31:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:31:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:24 trial106 ceph-mon[44052]: pgmap v223: 129 pgs: 129 active+clean; 104 MiB data, 884 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 138 op/s 2026-02-20T02:31:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:31:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:31:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:31:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:31:25.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 227287 5.86 MB/sec execute 88 sec latency 7.706 ms 2026-02-20T02:31:25.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 32444759 844.51 MB/sec execute 88 sec latency 17.047 ms 2026-02-20T02:31:26.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 228187 5.82 MB/sec execute 89 sec latency 8.974 ms 2026-02-20T02:31:26.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 32606093 845.01 MB/sec execute 89 sec latency 0.268 ms 2026-02-20T02:31:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:26 trial098 ceph-mon[38923]: pgmap v224: 129 pgs: 129 active+clean; 104 MiB data, 889 MiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T02:31:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:26 trial106 ceph-mon[44052]: pgmap v224: 129 pgs: 129 active+clean; 104 MiB data, 889 MiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T02:31:27.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 229363 5.81 MB/sec execute 90 sec latency 8.458 ms 2026-02-20T02:31:27.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 32766517 845.23 MB/sec execute 90 sec latency 0.249 ms 2026-02-20T02:31:28.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 230565 5.87 MB/sec execute 91 sec latency 8.327 ms 2026-02-20T02:31:28.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 32927891 845.47 MB/sec execute 91 sec latency 0.265 ms 2026-02-20T02:31:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:28 trial098 ceph-mon[38923]: pgmap v225: 129 pgs: 129 active+clean; 106 MiB data, 894 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 3.0 MiB/s wr, 139 op/s 2026-02-20T02:31:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:28 trial106 ceph-mon[44052]: pgmap v225: 129 pgs: 129 active+clean; 106 MiB data, 894 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 3.0 MiB/s wr, 139 op/s 2026-02-20T02:31:29.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 231469 5.83 MB/sec execute 92 sec latency 7.400 ms 2026-02-20T02:31:29.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 33086934 845.80 MB/sec execute 92 sec latency 0.329 ms 2026-02-20T02:31:30.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 232663 5.82 MB/sec execute 93 sec latency 7.942 ms 2026-02-20T02:31:30.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 33247617 846.01 MB/sec execute 93 sec latency 0.282 ms 2026-02-20T02:31:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:30 trial098 ceph-mon[38923]: pgmap v226: 129 pgs: 129 active+clean; 106 MiB data, 881 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.4 MiB/s wr, 115 op/s 2026-02-20T02:31:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:30 trial106 ceph-mon[44052]: pgmap v226: 129 pgs: 129 active+clean; 106 MiB data, 881 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.4 MiB/s wr, 115 op/s 2026-02-20T02:31:31.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 233924 5.85 MB/sec execute 94 sec latency 7.692 ms 2026-02-20T02:31:31.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 33407647 846.19 MB/sec execute 94 sec latency 11.761 ms 2026-02-20T02:31:32.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 234842 5.84 MB/sec execute 95 sec latency 6.946 ms 2026-02-20T02:31:32.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 33569023 846.66 MB/sec execute 95 sec latency 15.690 ms 2026-02-20T02:31:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:32 trial098 ceph-mon[38923]: pgmap v227: 129 pgs: 129 active+clean; 107 MiB data, 887 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 139 op/s 2026-02-20T02:31:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:32 trial106 ceph-mon[44052]: pgmap v227: 129 pgs: 129 active+clean; 107 MiB data, 887 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 139 op/s 2026-02-20T02:31:33.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 236062 5.83 MB/sec execute 96 sec latency 7.383 ms 2026-02-20T02:31:33.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 33730439 846.88 MB/sec execute 96 sec latency 0.270 ms 2026-02-20T02:31:33.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:31:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:31:34.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 237439 5.87 MB/sec execute 97 sec latency 6.777 ms 2026-02-20T02:31:34.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 33890895 847.05 MB/sec execute 97 sec latency 0.266 ms 2026-02-20T02:31:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:34 trial098 ceph-mon[38923]: pgmap v228: 129 pgs: 129 active+clean; 108 MiB data, 888 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.9 MiB/s wr, 146 op/s 2026-02-20T02:31:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:34 trial106 ceph-mon[44052]: pgmap v228: 129 pgs: 129 active+clean; 108 MiB data, 888 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.9 MiB/s wr, 146 op/s 2026-02-20T02:31:35.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 238308 5.85 MB/sec execute 98 sec latency 7.175 ms 2026-02-20T02:31:35.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 34049167 847.32 MB/sec execute 98 sec latency 0.297 ms 2026-02-20T02:31:36.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 239508 5.85 MB/sec execute 99 sec latency 7.924 ms 2026-02-20T02:31:36.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 34210796 847.53 MB/sec execute 99 sec latency 0.283 ms 2026-02-20T02:31:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:36 trial098 ceph-mon[38923]: pgmap v229: 129 pgs: 129 active+clean; 108 MiB data, 892 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 122 op/s 2026-02-20T02:31:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:36 trial106 ceph-mon[44052]: pgmap v229: 129 pgs: 129 active+clean; 108 MiB data, 892 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 122 op/s 2026-02-20T02:31:37.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 240683 5.86 MB/sec execute 100 sec latency 30.933 ms 2026-02-20T02:31:37.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 34362774 847.26 MB/sec execute 100 sec latency 38.718 ms 2026-02-20T02:31:38.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 241680 5.87 MB/sec execute 101 sec latency 7.700 ms 2026-02-20T02:31:38.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 34522183 847.55 MB/sec execute 101 sec latency 0.336 ms 2026-02-20T02:31:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:38 trial098 ceph-mon[38923]: pgmap v230: 129 pgs: 129 active+clean; 109 MiB data, 904 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 127 op/s 2026-02-20T02:31:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:38 trial106 ceph-mon[44052]: pgmap v230: 129 pgs: 129 active+clean; 109 MiB data, 904 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 127 op/s 2026-02-20T02:31:39.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 242736 5.86 MB/sec execute 102 sec latency 8.258 ms 2026-02-20T02:31:39.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 34683414 847.75 MB/sec execute 102 sec latency 0.264 ms 2026-02-20T02:31:40.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 243819 5.83 MB/sec execute 103 sec latency 7.634 ms 2026-02-20T02:31:40.358 INFO:tasks.workunit.client.0.trial098.stdout: 1 34844530 848.14 MB/sec execute 103 sec latency 0.295 ms 2026-02-20T02:31:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:40 trial098 ceph-mon[38923]: pgmap v231: 129 pgs: 129 active+clean; 111 MiB data, 895 MiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-20T02:31:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:40 trial106 ceph-mon[44052]: pgmap v231: 129 pgs: 129 active+clean; 111 MiB data, 895 MiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-20T02:31:41.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 245053 5.88 MB/sec execute 104 sec latency 7.809 ms 2026-02-20T02:31:41.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 35000351 848.06 MB/sec execute 104 sec latency 13.177 ms 2026-02-20T02:31:42.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 245953 5.85 MB/sec execute 105 sec latency 8.122 ms 2026-02-20T02:31:42.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 35118661 846.06 MB/sec execute 105 sec latency 64.127 ms 2026-02-20T02:31:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:42 trial098 ceph-mon[38923]: pgmap v232: 129 pgs: 129 active+clean; 110 MiB data, 915 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 133 op/s 2026-02-20T02:31:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:42 trial106 ceph-mon[44052]: pgmap v232: 129 pgs: 129 active+clean; 110 MiB data, 915 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 133 op/s 2026-02-20T02:31:43.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 246680 5.82 MB/sec execute 106 sec latency 36.894 ms 2026-02-20T02:31:43.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 35177958 841.10 MB/sec execute 106 sec latency 67.862 ms 2026-02-20T02:31:44.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 248077 5.85 MB/sec execute 107 sec latency 7.185 ms 2026-02-20T02:31:44.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 35337375 841.40 MB/sec execute 107 sec latency 0.398 ms 2026-02-20T02:31:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:44 trial098 ceph-mon[38923]: pgmap v233: 129 pgs: 129 active+clean; 113 MiB data, 903 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-20T02:31:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:44 trial106 ceph-mon[44052]: pgmap v233: 129 pgs: 129 active+clean; 113 MiB data, 903 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-20T02:31:45.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 248899 5.84 MB/sec execute 108 sec latency 6.834 ms 2026-02-20T02:31:45.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 35499705 841.74 MB/sec execute 108 sec latency 0.313 ms 2026-02-20T02:31:46.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 249969 5.84 MB/sec execute 109 sec latency 7.968 ms 2026-02-20T02:31:46.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 35665120 842.22 MB/sec execute 109 sec latency 0.237 ms 2026-02-20T02:31:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:46 trial098 ceph-mon[38923]: pgmap v234: 129 pgs: 129 active+clean; 113 MiB data, 906 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-20T02:31:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:46 trial106 ceph-mon[44052]: pgmap v234: 129 pgs: 129 active+clean; 113 MiB data, 906 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-20T02:31:47.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 251046 5.84 MB/sec execute 110 sec latency 7.439 ms 2026-02-20T02:31:47.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 35825197 842.54 MB/sec execute 110 sec latency 8.675 ms 2026-02-20T02:31:48.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 252174 5.85 MB/sec execute 111 sec latency 6.864 ms 2026-02-20T02:31:48.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 35967943 841.88 MB/sec execute 111 sec latency 63.391 ms 2026-02-20T02:31:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:48 trial098 ceph-mon[38923]: pgmap v235: 129 pgs: 129 active+clean; 114 MiB data, 914 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2026-02-20T02:31:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:31:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:48 trial106 ceph-mon[44052]: pgmap v235: 129 pgs: 129 active+clean; 114 MiB data, 914 MiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2026-02-20T02:31:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:31:49.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 253021 5.82 MB/sec execute 112 sec latency 24.429 ms 2026-02-20T02:31:49.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 36117596 841.58 MB/sec execute 112 sec latency 43.257 ms 2026-02-20T02:31:50.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 254202 5.81 MB/sec execute 113 sec latency 8.014 ms 2026-02-20T02:31:50.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 36277611 841.90 MB/sec execute 113 sec latency 0.262 ms 2026-02-20T02:31:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:50 trial106 ceph-mon[44052]: pgmap v236: 129 pgs: 129 active+clean; 114 MiB data, 923 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T02:31:51.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 255402 5.86 MB/sec execute 114 sec latency 7.207 ms 2026-02-20T02:31:51.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:50 trial098 ceph-mon[38923]: pgmap v236: 129 pgs: 129 active+clean; 114 MiB data, 923 MiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T02:31:51.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 36440963 842.24 MB/sec execute 114 sec latency 0.262 ms 2026-02-20T02:31:52.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 256294 5.83 MB/sec execute 115 sec latency 7.632 ms 2026-02-20T02:31:52.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 36605710 842.64 MB/sec execute 115 sec latency 0.239 ms 2026-02-20T02:31:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:52 trial106 ceph-mon[44052]: pgmap v237: 129 pgs: 129 active+clean; 114 MiB data, 933 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.6 MiB/s wr, 111 op/s 2026-02-20T02:31:53.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 257467 5.82 MB/sec execute 116 sec latency 7.480 ms 2026-02-20T02:31:53.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:52 trial098 ceph-mon[38923]: pgmap v237: 129 pgs: 129 active+clean; 114 MiB data, 933 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.6 MiB/s wr, 111 op/s 2026-02-20T02:31:53.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 36765715 842.94 MB/sec execute 116 sec latency 0.279 ms 2026-02-20T02:31:54.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 258711 5.84 MB/sec execute 117 sec latency 28.055 ms 2026-02-20T02:31:54.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 36896064 841.77 MB/sec execute 117 sec latency 62.272 ms 2026-02-20T02:31:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:54 trial106 ceph-mon[44052]: pgmap v238: 129 pgs: 129 active+clean; 117 MiB data, 939 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.6 MiB/s wr, 137 op/s 2026-02-20T02:31:55.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 259540 5.83 MB/sec execute 118 sec latency 7.565 ms 2026-02-20T02:31:55.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:54 trial098 ceph-mon[38923]: pgmap v238: 129 pgs: 129 active+clean; 117 MiB data, 939 MiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.6 MiB/s wr, 137 op/s 2026-02-20T02:31:55.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 37056657 841.95 MB/sec execute 118 sec latency 0.573 ms 2026-02-20T02:31:56.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 260711 5.83 MB/sec execute 119 sec latency 7.455 ms 2026-02-20T02:31:56.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 37215278 842.22 MB/sec execute 119 sec latency 4.674 ms 2026-02-20T02:31:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:56 trial106 ceph-mon[44052]: pgmap v239: 129 pgs: 129 active+clean; 117 MiB data, 941 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2026-02-20T02:31:57.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 261961 5.84 MB/sec execute 120 sec latency 8.174 ms 2026-02-20T02:31:57.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:56 trial098 ceph-mon[38923]: pgmap v239: 129 pgs: 129 active+clean; 117 MiB data, 941 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2026-02-20T02:31:57.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 37373939 842.33 MB/sec execute 120 sec latency 7.120 ms 2026-02-20T02:31:58.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 262907 5.85 MB/sec execute 121 sec latency 7.457 ms 2026-02-20T02:31:58.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 37534050 842.52 MB/sec execute 121 sec latency 0.244 ms 2026-02-20T02:31:59.117 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:31:58 trial098 ceph-mon[38923]: pgmap v240: 129 pgs: 129 active+clean; 116 MiB data, 925 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 120 op/s 2026-02-20T02:31:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:31:58 trial106 ceph-mon[44052]: pgmap v240: 129 pgs: 129 active+clean; 116 MiB data, 925 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 120 op/s 2026-02-20T02:31:59.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 263896 5.84 MB/sec execute 122 sec latency 9.314 ms 2026-02-20T02:31:59.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 37692307 842.73 MB/sec execute 122 sec latency 0.292 ms 2026-02-20T02:32:00.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 264882 5.81 MB/sec execute 123 sec latency 26.058 ms 2026-02-20T02:32:00.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 37820702 841.49 MB/sec execute 123 sec latency 67.144 ms 2026-02-20T02:32:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:00 trial106 ceph-mon[44052]: pgmap v241: 129 pgs: 129 active+clean; 117 MiB data, 942 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:32:01.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 266167 5.85 MB/sec execute 124 sec latency 6.967 ms 2026-02-20T02:32:01.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:00 trial098 ceph-mon[38923]: pgmap v241: 129 pgs: 129 active+clean; 117 MiB data, 942 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:32:01.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 37981612 841.73 MB/sec execute 124 sec latency 0.239 ms 2026-02-20T02:32:02.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 267103 5.83 MB/sec execute 125 sec latency 8.466 ms 2026-02-20T02:32:02.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 38141663 842.02 MB/sec execute 125 sec latency 11.068 ms 2026-02-20T02:32:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:02 trial106 ceph-mon[44052]: pgmap v242: 129 pgs: 129 active+clean; 119 MiB data, 936 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2026-02-20T02:32:03.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 268290 5.81 MB/sec execute 126 sec latency 6.855 ms 2026-02-20T02:32:03.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:02 trial098 ceph-mon[38923]: pgmap v242: 129 pgs: 129 active+clean; 119 MiB data, 936 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2026-02-20T02:32:03.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 38301759 842.20 MB/sec execute 126 sec latency 0.263 ms 2026-02-20T02:32:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:32:04.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 269431 5.84 MB/sec execute 127 sec latency 8.066 ms 2026-02-20T02:32:04.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:32:04.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 38461615 842.35 MB/sec execute 127 sec latency 0.284 ms 2026-02-20T02:32:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:04 trial106 ceph-mon[44052]: pgmap v243: 129 pgs: 129 active+clean; 120 MiB data, 936 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 127 op/s 2026-02-20T02:32:05.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 270325 5.83 MB/sec execute 128 sec latency 7.570 ms 2026-02-20T02:32:05.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:04 trial098 ceph-mon[38923]: pgmap v243: 129 pgs: 129 active+clean; 120 MiB data, 936 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 127 op/s 2026-02-20T02:32:05.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 38622952 842.70 MB/sec execute 128 sec latency 0.425 ms 2026-02-20T02:32:06.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 271507 5.82 MB/sec execute 129 sec latency 6.804 ms 2026-02-20T02:32:06.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 38784051 842.89 MB/sec execute 129 sec latency 0.369 ms 2026-02-20T02:32:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:06 trial106 ceph-mon[44052]: pgmap v244: 129 pgs: 129 active+clean; 121 MiB data, 944 MiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-20T02:32:07.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 272883 5.85 MB/sec execute 130 sec latency 8.172 ms 2026-02-20T02:32:07.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:06 trial098 ceph-mon[38923]: pgmap v244: 129 pgs: 129 active+clean; 121 MiB data, 944 MiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-20T02:32:07.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 38945819 843.12 MB/sec execute 130 sec latency 0.771 ms 2026-02-20T02:32:08.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 273729 5.84 MB/sec execute 131 sec latency 6.409 ms 2026-02-20T02:32:08.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 39103528 843.28 MB/sec execute 131 sec latency 1.037 ms 2026-02-20T02:32:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:08 trial106 ceph-mon[44052]: pgmap v245: 129 pgs: 129 active+clean; 121 MiB data, 949 MiB used, 5.5 TiB / 5.5 TiB avail; 3.6 KiB/s rd, 2.9 MiB/s wr, 125 op/s 2026-02-20T02:32:09.119 INFO:tasks.workunit.client.1.trial106.stdout: 1 274833 5.83 MB/sec execute 132 sec latency 8.333 ms 2026-02-20T02:32:09.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:08 trial098 ceph-mon[38923]: pgmap v245: 129 pgs: 129 active+clean; 121 MiB data, 949 MiB used, 5.5 TiB / 5.5 TiB avail; 3.6 KiB/s rd, 2.9 MiB/s wr, 125 op/s 2026-02-20T02:32:09.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 39263100 843.41 MB/sec execute 132 sec latency 0.256 ms 2026-02-20T02:32:10.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 276114 5.85 MB/sec execute 133 sec latency 7.353 ms 2026-02-20T02:32:10.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 39420937 843.61 MB/sec execute 133 sec latency 0.421 ms 2026-02-20T02:32:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:10 trial106 ceph-mon[44052]: pgmap v246: 129 pgs: 129 active+clean; 121 MiB data, 960 MiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2026-02-20T02:32:11.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 277120 5.85 MB/sec execute 134 sec latency 6.696 ms 2026-02-20T02:32:11.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:10 trial098 ceph-mon[38923]: pgmap v246: 129 pgs: 129 active+clean; 121 MiB data, 960 MiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2026-02-20T02:32:11.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 39583647 843.86 MB/sec execute 134 sec latency 2.967 ms 2026-02-20T02:32:12.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 278148 5.84 MB/sec execute 135 sec latency 8.741 ms 2026-02-20T02:32:12.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 39741219 843.90 MB/sec execute 135 sec latency 18.713 ms 2026-02-20T02:32:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:12 trial106 ceph-mon[44052]: pgmap v247: 129 pgs: 129 active+clean; 123 MiB data, 983 MiB used, 5.5 TiB / 5.5 TiB avail; 3.8 KiB/s rd, 2.9 MiB/s wr, 121 op/s 2026-02-20T02:32:13.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 279301 5.82 MB/sec execute 136 sec latency 8.864 ms 2026-02-20T02:32:13.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:12 trial098 ceph-mon[38923]: pgmap v247: 129 pgs: 129 active+clean; 123 MiB data, 983 MiB used, 5.5 TiB / 5.5 TiB avail; 3.8 KiB/s rd, 2.9 MiB/s wr, 121 op/s 2026-02-20T02:32:13.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 39901479 844.18 MB/sec execute 136 sec latency 0.273 ms 2026-02-20T02:32:14.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 280546 5.86 MB/sec execute 137 sec latency 6.736 ms 2026-02-20T02:32:14.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 40060402 844.28 MB/sec execute 137 sec latency 0.247 ms 2026-02-20T02:32:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:14 trial106 ceph-mon[44052]: pgmap v248: 129 pgs: 129 active+clean; 122 MiB data, 970 MiB used, 5.5 TiB / 5.5 TiB avail; 3.8 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-20T02:32:15.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 281464 5.83 MB/sec execute 138 sec latency 7.823 ms 2026-02-20T02:32:15.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:14 trial098 ceph-mon[38923]: pgmap v248: 129 pgs: 129 active+clean; 122 MiB data, 970 MiB used, 5.5 TiB / 5.5 TiB avail; 3.8 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-20T02:32:15.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 40222274 844.46 MB/sec execute 138 sec latency 0.287 ms 2026-02-20T02:32:16.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 282610 5.83 MB/sec execute 139 sec latency 15.072 ms 2026-02-20T02:32:16.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 40375668 844.45 MB/sec execute 139 sec latency 36.862 ms 2026-02-20T02:32:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:16 trial106 ceph-mon[44052]: pgmap v249: 129 pgs: 129 active+clean; 124 MiB data, 977 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2026-02-20T02:32:17.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 283868 5.86 MB/sec execute 140 sec latency 8.043 ms 2026-02-20T02:32:17.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:16 trial098 ceph-mon[38923]: pgmap v249: 129 pgs: 129 active+clean; 124 MiB data, 977 MiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2026-02-20T02:32:17.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 40538747 844.70 MB/sec execute 140 sec latency 0.253 ms 2026-02-20T02:32:18.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 284763 5.84 MB/sec execute 141 sec latency 7.664 ms 2026-02-20T02:32:18.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 40700895 844.92 MB/sec execute 141 sec latency 1.179 ms 2026-02-20T02:32:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:18 trial106 ceph-mon[44052]: pgmap v250: 129 pgs: 129 active+clean; 125 MiB data, 982 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T02:32:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:32:19.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 285927 5.83 MB/sec execute 142 sec latency 7.263 ms 2026-02-20T02:32:19.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:18 trial098 ceph-mon[38923]: pgmap v250: 129 pgs: 129 active+clean; 125 MiB data, 982 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T02:32:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:32:19.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 40858431 845.07 MB/sec execute 142 sec latency 0.279 ms 2026-02-20T02:32:20.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 287114 5.85 MB/sec execute 143 sec latency 7.448 ms 2026-02-20T02:32:20.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 41020245 845.27 MB/sec execute 143 sec latency 0.569 ms 2026-02-20T02:32:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:20 trial106 ceph-mon[44052]: pgmap v251: 129 pgs: 129 active+clean; 126 MiB data, 991 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-20T02:32:21.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 287839 5.84 MB/sec execute 144 sec latency 29.970 ms 2026-02-20T02:32:21.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:20 trial098 ceph-mon[38923]: pgmap v251: 129 pgs: 129 active+clean; 126 MiB data, 991 MiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-20T02:32:21.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 41062513 840.99 MB/sec execute 144 sec latency 67.243 ms 2026-02-20T02:32:22.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 288916 5.84 MB/sec execute 145 sec latency 28.732 ms 2026-02-20T02:32:22.359 INFO:tasks.workunit.client.0.trial098.stdout: 1 41219112 841.00 MB/sec execute 145 sec latency 10.869 ms 2026-02-20T02:32:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:22 trial106 ceph-mon[44052]: pgmap v252: 129 pgs: 129 active+clean; 127 MiB data, 1016 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 3.0 MiB/s wr, 150 op/s 2026-02-20T02:32:23.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 290208 5.84 MB/sec execute 146 sec latency 6.716 ms 2026-02-20T02:32:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:22 trial098 ceph-mon[38923]: pgmap v252: 129 pgs: 129 active+clean; 127 MiB data, 1016 MiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 3.0 MiB/s wr, 150 op/s 2026-02-20T02:32:23.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 41381075 841.32 MB/sec execute 146 sec latency 1.180 ms 2026-02-20T02:32:24.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 291245 5.85 MB/sec execute 147 sec latency 7.025 ms 2026-02-20T02:32:24.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 41543673 841.57 MB/sec execute 147 sec latency 0.244 ms 2026-02-20T02:32:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:24 trial106 ceph-mon[44052]: pgmap v253: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-20T02:32:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:32:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:32:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:32:25.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:24 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:32:25.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 292259 5.85 MB/sec execute 148 sec latency 8.157 ms 2026-02-20T02:32:25.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:24 trial098 ceph-mon[38923]: pgmap v253: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-20T02:32:25.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:32:25.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:32:25.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:32:25.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:24 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:32:25.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 41704761 841.76 MB/sec execute 148 sec latency 0.245 ms 2026-02-20T02:32:26.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 293316 5.82 MB/sec execute 149 sec latency 7.690 ms 2026-02-20T02:32:26.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 41865823 842.06 MB/sec execute 149 sec latency 0.805 ms 2026-02-20T02:32:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:26 trial106 ceph-mon[44052]: pgmap v254: 129 pgs: 129 active+clean; 128 MiB data, 1016 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-20T02:32:27.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 294652 5.86 MB/sec execute 150 sec latency 7.392 ms 2026-02-20T02:32:27.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:26 trial098 ceph-mon[38923]: pgmap v254: 129 pgs: 129 active+clean; 128 MiB data, 1016 MiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-20T02:32:27.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 42029633 842.33 MB/sec execute 150 sec latency 0.245 ms 2026-02-20T02:32:28.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 295548 5.84 MB/sec execute 151 sec latency 7.639 ms 2026-02-20T02:32:28.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 42187490 842.48 MB/sec execute 151 sec latency 20.010 ms 2026-02-20T02:32:29.116 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:28 trial098 ceph-mon[38923]: pgmap v255: 129 pgs: 129 active+clean; 130 MiB data, 1022 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 128 op/s 2026-02-20T02:32:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:28 trial106 ceph-mon[44052]: pgmap v255: 129 pgs: 129 active+clean; 130 MiB data, 1022 MiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 128 op/s 2026-02-20T02:32:29.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 296796 5.83 MB/sec execute 152 sec latency 7.091 ms 2026-02-20T02:32:29.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 42351756 842.78 MB/sec execute 152 sec latency 0.271 ms 2026-02-20T02:32:30.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 298008 5.86 MB/sec execute 153 sec latency 7.959 ms 2026-02-20T02:32:30.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 42509654 842.84 MB/sec execute 153 sec latency 0.234 ms 2026-02-20T02:32:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:30 trial106 ceph-mon[44052]: pgmap v256: 129 pgs: 129 active+clean; 129 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 119 op/s 2026-02-20T02:32:31.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 298911 5.84 MB/sec execute 154 sec latency 7.770 ms 2026-02-20T02:32:31.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:30 trial098 ceph-mon[38923]: pgmap v256: 129 pgs: 129 active+clean; 129 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 119 op/s 2026-02-20T02:32:31.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 42669117 843.06 MB/sec execute 154 sec latency 0.265 ms 2026-02-20T02:32:32.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 300066 5.84 MB/sec execute 155 sec latency 7.344 ms 2026-02-20T02:32:32.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 42829367 843.19 MB/sec execute 155 sec latency 0.252 ms 2026-02-20T02:32:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:32 trial106 ceph-mon[44052]: pgmap v257: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.9 MiB/s wr, 144 op/s 2026-02-20T02:32:33.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 301305 5.85 MB/sec execute 156 sec latency 8.224 ms 2026-02-20T02:32:33.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:32 trial098 ceph-mon[38923]: pgmap v257: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.9 MiB/s wr, 144 op/s 2026-02-20T02:32:33.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 42987606 843.25 MB/sec execute 156 sec latency 4.009 ms 2026-02-20T02:32:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:32:34.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 302245 5.85 MB/sec execute 157 sec latency 7.784 ms 2026-02-20T02:32:34.245 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:32:34.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 43148359 843.52 MB/sec execute 157 sec latency 0.273 ms 2026-02-20T02:32:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:34 trial106 ceph-mon[44052]: pgmap v258: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-20T02:32:35.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 303354 5.84 MB/sec execute 158 sec latency 8.047 ms 2026-02-20T02:32:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:34 trial098 ceph-mon[38923]: pgmap v258: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-20T02:32:35.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 43310754 843.71 MB/sec execute 158 sec latency 0.260 ms 2026-02-20T02:32:36.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 304687 5.86 MB/sec execute 159 sec latency 9.149 ms 2026-02-20T02:32:36.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 43471274 843.86 MB/sec execute 159 sec latency 0.254 ms 2026-02-20T02:32:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:36 trial106 ceph-mon[44052]: pgmap v259: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:32:37.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 305552 5.86 MB/sec execute 160 sec latency 7.248 ms 2026-02-20T02:32:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:36 trial098 ceph-mon[38923]: pgmap v259: 129 pgs: 129 active+clean; 132 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:32:37.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 43627626 843.95 MB/sec execute 160 sec latency 5.841 ms 2026-02-20T02:32:38.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 306677 5.85 MB/sec execute 161 sec latency 7.811 ms 2026-02-20T02:32:38.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 43786297 844.01 MB/sec execute 161 sec latency 6.681 ms 2026-02-20T02:32:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:38 trial106 ceph-mon[44052]: pgmap v260: 129 pgs: 129 active+clean; 133 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 139 op/s 2026-02-20T02:32:39.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 307826 5.85 MB/sec execute 162 sec latency 7.008 ms 2026-02-20T02:32:39.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:38 trial098 ceph-mon[38923]: pgmap v260: 129 pgs: 129 active+clean; 133 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 139 op/s 2026-02-20T02:32:39.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 43949572 844.23 MB/sec execute 162 sec latency 1.014 ms 2026-02-20T02:32:40.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 308885 5.86 MB/sec execute 163 sec latency 7.617 ms 2026-02-20T02:32:40.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 44112691 844.56 MB/sec execute 163 sec latency 0.276 ms 2026-02-20T02:32:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:40 trial106 ceph-mon[44052]: pgmap v261: 129 pgs: 129 active+clean; 133 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2026-02-20T02:32:41.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 309790 5.84 MB/sec execute 164 sec latency 9.051 ms 2026-02-20T02:32:41.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:40 trial098 ceph-mon[38923]: pgmap v261: 129 pgs: 129 active+clean; 133 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2026-02-20T02:32:41.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 44276002 844.78 MB/sec execute 164 sec latency 0.470 ms 2026-02-20T02:32:42.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 310986 5.84 MB/sec execute 165 sec latency 31.907 ms 2026-02-20T02:32:42.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 44423730 844.49 MB/sec execute 165 sec latency 63.322 ms 2026-02-20T02:32:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:42 trial106 ceph-mon[44052]: pgmap v262: 129 pgs: 129 active+clean; 135 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-20T02:32:43.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 312283 5.87 MB/sec execute 166 sec latency 6.746 ms 2026-02-20T02:32:43.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:42 trial098 ceph-mon[38923]: pgmap v262: 129 pgs: 129 active+clean; 135 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-20T02:32:43.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 44587281 844.83 MB/sec execute 166 sec latency 6.653 ms 2026-02-20T02:32:44.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 313124 5.84 MB/sec execute 167 sec latency 8.057 ms 2026-02-20T02:32:44.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 44750790 845.04 MB/sec execute 167 sec latency 0.280 ms 2026-02-20T02:32:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:44 trial106 ceph-mon[44052]: pgmap v263: 129 pgs: 129 active+clean; 136 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 112 op/s 2026-02-20T02:32:45.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 314339 5.84 MB/sec execute 168 sec latency 6.593 ms 2026-02-20T02:32:45.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:44 trial098 ceph-mon[38923]: pgmap v263: 129 pgs: 129 active+clean; 136 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 112 op/s 2026-02-20T02:32:45.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 44914307 845.25 MB/sec execute 168 sec latency 0.585 ms 2026-02-20T02:32:46.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 315659 5.87 MB/sec execute 169 sec latency 6.907 ms 2026-02-20T02:32:46.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 45080015 845.63 MB/sec execute 169 sec latency 0.283 ms 2026-02-20T02:32:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:46 trial106 ceph-mon[44052]: pgmap v264: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-20T02:32:47.120 INFO:tasks.workunit.client.1.trial106.stdout: 1 316568 5.85 MB/sec execute 170 sec latency 8.105 ms 2026-02-20T02:32:47.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:46 trial098 ceph-mon[38923]: pgmap v264: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-20T02:32:47.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 45204476 844.61 MB/sec execute 170 sec latency 94.749 ms 2026-02-20T02:32:48.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 317265 5.84 MB/sec execute 171 sec latency 48.830 ms 2026-02-20T02:32:48.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 45231457 840.52 MB/sec execute 171 sec latency 88.004 ms 2026-02-20T02:32:49.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 318421 5.84 MB/sec execute 172 sec latency 21.564 ms 2026-02-20T02:32:49.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:48 trial098 ceph-mon[38923]: pgmap v265: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 145 op/s 2026-02-20T02:32:49.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:32:49.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 45396297 840.89 MB/sec execute 172 sec latency 0.320 ms 2026-02-20T02:32:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:48 trial106 ceph-mon[44052]: pgmap v265: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 145 op/s 2026-02-20T02:32:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:32:50.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 319604 5.86 MB/sec execute 173 sec latency 6.646 ms 2026-02-20T02:32:50.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 45560637 841.17 MB/sec execute 173 sec latency 0.518 ms 2026-02-20T02:32:51.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 320648 5.85 MB/sec execute 174 sec latency 7.633 ms 2026-02-20T02:32:51.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:50 trial098 ceph-mon[38923]: pgmap v266: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:32:51.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 45726994 841.48 MB/sec execute 174 sec latency 0.241 ms 2026-02-20T02:32:51.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:50 trial106 ceph-mon[44052]: pgmap v266: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:32:52.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 321718 5.83 MB/sec execute 175 sec latency 7.905 ms 2026-02-20T02:32:52.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 45889900 841.77 MB/sec execute 175 sec latency 0.268 ms 2026-02-20T02:32:53.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 322932 5.86 MB/sec execute 176 sec latency 9.078 ms 2026-02-20T02:32:53.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:52 trial098 ceph-mon[38923]: pgmap v267: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-20T02:32:53.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 46037388 841.52 MB/sec execute 176 sec latency 50.654 ms 2026-02-20T02:32:53.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:52 trial106 ceph-mon[44052]: pgmap v267: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-20T02:32:54.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 323741 5.84 MB/sec execute 177 sec latency 37.590 ms 2026-02-20T02:32:54.360 INFO:tasks.workunit.client.0.trial098.stdout: 1 46187014 841.33 MB/sec execute 177 sec latency 66.438 ms 2026-02-20T02:32:55.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 324870 5.83 MB/sec execute 178 sec latency 7.801 ms 2026-02-20T02:32:55.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:54 trial098 ceph-mon[38923]: pgmap v268: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-20T02:32:55.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 46350454 841.64 MB/sec execute 178 sec latency 0.284 ms 2026-02-20T02:32:55.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:54 trial106 ceph-mon[44052]: pgmap v268: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-20T02:32:56.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 326111 5.85 MB/sec execute 179 sec latency 7.722 ms 2026-02-20T02:32:56.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 46516328 841.95 MB/sec execute 179 sec latency 0.385 ms 2026-02-20T02:32:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:56 trial106 ceph-mon[44052]: pgmap v269: 129 pgs: 129 active+clean; 140 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 134 op/s 2026-02-20T02:32:57.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 326964 5.84 MB/sec execute 180 sec latency 8.019 ms 2026-02-20T02:32:57.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:56 trial098 ceph-mon[38923]: pgmap v269: 129 pgs: 129 active+clean; 140 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 134 op/s 2026-02-20T02:32:57.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 46682339 842.24 MB/sec execute 180 sec latency 1.086 ms 2026-02-20T02:32:58.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 328147 5.84 MB/sec execute 181 sec latency 7.565 ms 2026-02-20T02:32:58.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 46842160 842.42 MB/sec execute 181 sec latency 7.687 ms 2026-02-20T02:32:58.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:32:58 trial098 ceph-mon[38923]: pgmap v270: 129 pgs: 129 active+clean; 141 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 120 op/s 2026-02-20T02:32:58.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:32:58 trial106 ceph-mon[44052]: pgmap v270: 129 pgs: 129 active+clean; 141 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 120 op/s 2026-02-20T02:32:59.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 329215 5.84 MB/sec execute 182 sec latency 49.786 ms 2026-02-20T02:32:59.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 46959220 841.26 MB/sec execute 182 sec latency 68.422 ms 2026-02-20T02:33:00.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 330258 5.85 MB/sec execute 183 sec latency 34.591 ms 2026-02-20T02:33:00.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 47123978 841.54 MB/sec execute 183 sec latency 0.739 ms 2026-02-20T02:33:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:00 trial098 ceph-mon[38923]: pgmap v271: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 2.5 MiB/s wr, 122 op/s 2026-02-20T02:33:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:00 trial106 ceph-mon[44052]: pgmap v271: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 2.5 MiB/s wr, 122 op/s 2026-02-20T02:33:01.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 331289 5.85 MB/sec execute 184 sec latency 7.815 ms 2026-02-20T02:33:01.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 47288028 841.86 MB/sec execute 184 sec latency 0.269 ms 2026-02-20T02:33:02.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 332353 5.83 MB/sec execute 185 sec latency 7.430 ms 2026-02-20T02:33:02.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 47452843 842.10 MB/sec execute 185 sec latency 0.267 ms 2026-02-20T02:33:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:02 trial098 ceph-mon[38923]: pgmap v272: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.0 KiB/s rd, 2.8 MiB/s wr, 121 op/s 2026-02-20T02:33:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:02 trial106 ceph-mon[44052]: pgmap v272: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.0 KiB/s rd, 2.8 MiB/s wr, 121 op/s 2026-02-20T02:33:03.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 333656 5.86 MB/sec execute 186 sec latency 7.228 ms 2026-02-20T02:33:03.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 47621847 842.48 MB/sec execute 186 sec latency 0.259 ms 2026-02-20T02:33:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:33:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:33:04.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 334521 5.84 MB/sec execute 187 sec latency 15.342 ms 2026-02-20T02:33:04.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 47778848 842.59 MB/sec execute 187 sec latency 25.268 ms 2026-02-20T02:33:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:04 trial098 ceph-mon[38923]: pgmap v273: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.0 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-20T02:33:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:04 trial106 ceph-mon[44052]: pgmap v273: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.0 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-20T02:33:05.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 335735 5.83 MB/sec execute 188 sec latency 6.964 ms 2026-02-20T02:33:05.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 47943116 842.81 MB/sec execute 188 sec latency 0.523 ms 2026-02-20T02:33:06.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 336819 5.84 MB/sec execute 189 sec latency 8.369 ms 2026-02-20T02:33:06.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 48106856 843.03 MB/sec execute 189 sec latency 0.735 ms 2026-02-20T02:33:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:06 trial098 ceph-mon[38923]: pgmap v274: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-20T02:33:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:06 trial106 ceph-mon[44052]: pgmap v274: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-20T02:33:07.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 337840 5.84 MB/sec execute 190 sec latency 7.125 ms 2026-02-20T02:33:07.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 48271354 843.35 MB/sec execute 190 sec latency 0.440 ms 2026-02-20T02:33:08.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 338898 5.84 MB/sec execute 191 sec latency 7.899 ms 2026-02-20T02:33:08.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 48438825 843.67 MB/sec execute 191 sec latency 0.237 ms 2026-02-20T02:33:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:08 trial098 ceph-mon[38923]: pgmap v275: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-20T02:33:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:08 trial106 ceph-mon[44052]: pgmap v275: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-20T02:33:09.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 340270 5.85 MB/sec execute 192 sec latency 7.771 ms 2026-02-20T02:33:09.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 48603008 843.97 MB/sec execute 192 sec latency 2.710 ms 2026-02-20T02:33:10.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 341093 5.85 MB/sec execute 193 sec latency 7.118 ms 2026-02-20T02:33:10.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 48768144 844.21 MB/sec execute 193 sec latency 0.238 ms 2026-02-20T02:33:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:10 trial098 ceph-mon[38923]: pgmap v276: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.3 MiB/s wr, 122 op/s 2026-02-20T02:33:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:10 trial106 ceph-mon[44052]: pgmap v276: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.3 MiB/s wr, 122 op/s 2026-02-20T02:33:11.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 342168 5.84 MB/sec execute 194 sec latency 8.170 ms 2026-02-20T02:33:11.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 48934437 844.47 MB/sec execute 194 sec latency 0.267 ms 2026-02-20T02:33:12.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 343455 5.85 MB/sec execute 195 sec latency 8.533 ms 2026-02-20T02:33:12.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 49098873 844.78 MB/sec execute 195 sec latency 0.270 ms 2026-02-20T02:33:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:12 trial098 ceph-mon[38923]: pgmap v277: 129 pgs: 129 active+clean; 147 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 130 op/s 2026-02-20T02:33:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:12 trial106 ceph-mon[44052]: pgmap v277: 129 pgs: 129 active+clean; 147 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 130 op/s 2026-02-20T02:33:13.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 344456 5.85 MB/sec execute 196 sec latency 7.772 ms 2026-02-20T02:33:13.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 49259907 844.90 MB/sec execute 196 sec latency 14.180 ms 2026-02-20T02:33:14.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 345491 5.85 MB/sec execute 197 sec latency 7.409 ms 2026-02-20T02:33:14.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 49424436 845.10 MB/sec execute 197 sec latency 0.279 ms 2026-02-20T02:33:15.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:14 trial098 ceph-mon[38923]: pgmap v278: 129 pgs: 129 active+clean; 147 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:33:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:14 trial106 ceph-mon[44052]: pgmap v278: 129 pgs: 129 active+clean; 147 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:33:15.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 346547 5.83 MB/sec execute 198 sec latency 20.625 ms 2026-02-20T02:33:15.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 49580421 845.17 MB/sec execute 198 sec latency 37.469 ms 2026-02-20T02:33:16.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 347856 5.86 MB/sec execute 199 sec latency 6.781 ms 2026-02-20T02:33:16.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 49743110 845.34 MB/sec execute 199 sec latency 0.353 ms 2026-02-20T02:33:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:16 trial098 ceph-mon[38923]: pgmap v279: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:33:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:16 trial106 ceph-mon[44052]: pgmap v279: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:33:17.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 348777 5.84 MB/sec execute 200 sec latency 9.004 ms 2026-02-20T02:33:17.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 49905788 845.51 MB/sec execute 200 sec latency 0.639 ms 2026-02-20T02:33:18.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 349983 5.84 MB/sec execute 201 sec latency 6.907 ms 2026-02-20T02:33:18.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 50067836 845.71 MB/sec execute 201 sec latency 0.278 ms 2026-02-20T02:33:18.919 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:18 trial106 ceph-mon[44052]: pgmap v280: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 3.0 MiB/s wr, 129 op/s 2026-02-20T02:33:18.919 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:33:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:18 trial098 ceph-mon[38923]: pgmap v280: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 3.0 MiB/s wr, 129 op/s 2026-02-20T02:33:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:33:19.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 351227 5.86 MB/sec execute 202 sec latency 7.284 ms 2026-02-20T02:33:19.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 50231760 845.90 MB/sec execute 202 sec latency 4.498 ms 2026-02-20T02:33:20.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 352022 5.84 MB/sec execute 203 sec latency 39.579 ms 2026-02-20T02:33:20.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 50318427 844.04 MB/sec execute 203 sec latency 68.497 ms 2026-02-20T02:33:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:20 trial098 ceph-mon[38923]: pgmap v281: 129 pgs: 129 active+clean; 150 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:33:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:20 trial106 ceph-mon[44052]: pgmap v281: 129 pgs: 129 active+clean; 150 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:33:21.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 352990 5.84 MB/sec execute 204 sec latency 30.054 ms 2026-02-20T02:33:21.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 50439237 843.19 MB/sec execute 204 sec latency 56.921 ms 2026-02-20T02:33:22.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 354150 5.84 MB/sec execute 205 sec latency 7.984 ms 2026-02-20T02:33:22.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 50602747 843.37 MB/sec execute 205 sec latency 0.255 ms 2026-02-20T02:33:23.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:22 trial098 ceph-mon[38923]: pgmap v282: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 143 op/s 2026-02-20T02:33:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:22 trial106 ceph-mon[44052]: pgmap v282: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 143 op/s 2026-02-20T02:33:23.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 355161 5.85 MB/sec execute 206 sec latency 6.462 ms 2026-02-20T02:33:23.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 50768333 843.61 MB/sec execute 206 sec latency 0.424 ms 2026-02-20T02:33:24.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 356197 5.84 MB/sec execute 207 sec latency 7.958 ms 2026-02-20T02:33:24.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 50933038 843.91 MB/sec execute 207 sec latency 0.273 ms 2026-02-20T02:33:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:24 trial098 ceph-mon[38923]: pgmap v283: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 119 op/s 2026-02-20T02:33:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:24 trial106 ceph-mon[44052]: pgmap v283: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 119 op/s 2026-02-20T02:33:25.121 INFO:tasks.workunit.client.1.trial106.stdout: 1 357290 5.83 MB/sec execute 208 sec latency 7.810 ms 2026-02-20T02:33:25.361 INFO:tasks.workunit.client.0.trial098.stdout: 1 51093398 844.00 MB/sec execute 208 sec latency 0.267 ms 2026-02-20T02:33:26.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:33:26.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:33:26.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:33:26.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:33:26.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:33:26.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:33:26.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:33:26.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:33:26.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 358551 5.85 MB/sec execute 209 sec latency 6.543 ms 2026-02-20T02:33:26.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 51258570 844.22 MB/sec execute 209 sec latency 0.460 ms 2026-02-20T02:33:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:26 trial098 ceph-mon[38923]: pgmap v284: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2026-02-20T02:33:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:26 trial106 ceph-mon[44052]: pgmap v284: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2026-02-20T02:33:27.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 359479 5.84 MB/sec execute 210 sec latency 8.072 ms 2026-02-20T02:33:27.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 51422082 844.47 MB/sec execute 210 sec latency 0.883 ms 2026-02-20T02:33:28.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 360639 5.83 MB/sec execute 211 sec latency 8.023 ms 2026-02-20T02:33:28.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 51585182 844.64 MB/sec execute 211 sec latency 5.888 ms 2026-02-20T02:33:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:28 trial098 ceph-mon[38923]: pgmap v285: 129 pgs: 129 active+clean; 152 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 139 op/s 2026-02-20T02:33:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:28 trial106 ceph-mon[44052]: pgmap v285: 129 pgs: 129 active+clean; 152 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 139 op/s 2026-02-20T02:33:29.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 361910 5.86 MB/sec execute 212 sec latency 7.901 ms 2026-02-20T02:33:29.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 51753572 844.95 MB/sec execute 212 sec latency 2.408 ms 2026-02-20T02:33:30.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 362832 5.84 MB/sec execute 213 sec latency 7.664 ms 2026-02-20T02:33:30.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 51917654 845.22 MB/sec execute 213 sec latency 0.257 ms 2026-02-20T02:33:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:30 trial098 ceph-mon[38923]: pgmap v286: 129 pgs: 129 active+clean; 154 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2026-02-20T02:33:31.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:30 trial106 ceph-mon[44052]: pgmap v286: 129 pgs: 129 active+clean; 154 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2026-02-20T02:33:31.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 363975 5.83 MB/sec execute 214 sec latency 7.014 ms 2026-02-20T02:33:31.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 52050185 844.60 MB/sec execute 214 sec latency 70.067 ms 2026-02-20T02:33:32.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 365092 5.85 MB/sec execute 215 sec latency 34.109 ms 2026-02-20T02:33:32.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 52183847 844.02 MB/sec execute 215 sec latency 54.659 ms 2026-02-20T02:33:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:32 trial098 ceph-mon[38923]: pgmap v287: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 139 op/s 2026-02-20T02:33:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:32 trial106 ceph-mon[44052]: pgmap v287: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 139 op/s 2026-02-20T02:33:33.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 365966 5.84 MB/sec execute 216 sec latency 8.098 ms 2026-02-20T02:33:33.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 52347264 844.28 MB/sec execute 216 sec latency 9.877 ms 2026-02-20T02:33:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:33:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:33:34.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 367116 5.84 MB/sec execute 217 sec latency 7.507 ms 2026-02-20T02:33:34.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 52514275 844.54 MB/sec execute 217 sec latency 4.799 ms 2026-02-20T02:33:34.941 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:34 trial098 ceph-mon[38923]: pgmap v288: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 119 op/s 2026-02-20T02:33:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:34 trial106 ceph-mon[44052]: pgmap v288: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 119 op/s 2026-02-20T02:33:35.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 368355 5.85 MB/sec execute 218 sec latency 11.512 ms 2026-02-20T02:33:35.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 52679288 844.73 MB/sec execute 218 sec latency 5.211 ms 2026-02-20T02:33:36.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 369360 5.85 MB/sec execute 219 sec latency 6.682 ms 2026-02-20T02:33:36.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 52840062 844.92 MB/sec execute 219 sec latency 0.666 ms 2026-02-20T02:33:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:36 trial098 ceph-mon[38923]: pgmap v289: 129 pgs: 129 active+clean; 156 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 140 op/s 2026-02-20T02:33:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:36 trial106 ceph-mon[44052]: pgmap v289: 129 pgs: 129 active+clean; 156 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 140 op/s 2026-02-20T02:33:37.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 370364 5.85 MB/sec execute 220 sec latency 31.376 ms 2026-02-20T02:33:37.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 52969069 844.24 MB/sec execute 220 sec latency 72.296 ms 2026-02-20T02:33:38.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 371446 5.83 MB/sec execute 221 sec latency 7.071 ms 2026-02-20T02:33:38.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 53134993 844.47 MB/sec execute 221 sec latency 0.250 ms 2026-02-20T02:33:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:38 trial098 ceph-mon[38923]: pgmap v290: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 139 op/s 2026-02-20T02:33:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:38 trial106 ceph-mon[44052]: pgmap v290: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 139 op/s 2026-02-20T02:33:39.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 372673 5.86 MB/sec execute 222 sec latency 7.324 ms 2026-02-20T02:33:39.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 53297458 844.68 MB/sec execute 222 sec latency 2.659 ms 2026-02-20T02:33:40.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 373504 5.84 MB/sec execute 223 sec latency 8.110 ms 2026-02-20T02:33:40.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 53462873 844.90 MB/sec execute 223 sec latency 0.236 ms 2026-02-20T02:33:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:40 trial098 ceph-mon[38923]: pgmap v291: 129 pgs: 129 active+clean; 156 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2026-02-20T02:33:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:40 trial106 ceph-mon[44052]: pgmap v291: 129 pgs: 129 active+clean; 156 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2026-02-20T02:33:41.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 374734 5.84 MB/sec execute 224 sec latency 7.759 ms 2026-02-20T02:33:41.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 53626902 845.15 MB/sec execute 224 sec latency 0.252 ms 2026-02-20T02:33:42.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 375956 5.86 MB/sec execute 225 sec latency 7.895 ms 2026-02-20T02:33:42.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 53792602 845.36 MB/sec execute 225 sec latency 0.281 ms 2026-02-20T02:33:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:42 trial098 ceph-mon[38923]: pgmap v292: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 145 op/s 2026-02-20T02:33:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:42 trial106 ceph-mon[44052]: pgmap v292: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 145 op/s 2026-02-20T02:33:43.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 376764 5.84 MB/sec execute 226 sec latency 24.333 ms 2026-02-20T02:33:43.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 53924731 844.78 MB/sec execute 226 sec latency 55.529 ms 2026-02-20T02:33:44.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 377941 5.84 MB/sec execute 227 sec latency 7.408 ms 2026-02-20T02:33:44.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 54090726 845.06 MB/sec execute 227 sec latency 0.262 ms 2026-02-20T02:33:45.057 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:44 trial098 ceph-mon[38923]: pgmap v293: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-20T02:33:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:44 trial106 ceph-mon[44052]: pgmap v293: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-20T02:33:45.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 379320 5.85 MB/sec execute 228 sec latency 7.756 ms 2026-02-20T02:33:45.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 54254694 845.24 MB/sec execute 228 sec latency 0.341 ms 2026-02-20T02:33:46.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 380248 5.85 MB/sec execute 229 sec latency 8.640 ms 2026-02-20T02:33:46.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 54417771 845.39 MB/sec execute 229 sec latency 0.245 ms 2026-02-20T02:33:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:46 trial098 ceph-mon[38923]: pgmap v294: 129 pgs: 129 active+clean; 159 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:33:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:46 trial106 ceph-mon[44052]: pgmap v294: 129 pgs: 129 active+clean; 159 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:33:47.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 381411 5.84 MB/sec execute 230 sec latency 7.603 ms 2026-02-20T02:33:47.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 54579628 845.58 MB/sec execute 230 sec latency 0.265 ms 2026-02-20T02:33:48.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 382759 5.85 MB/sec execute 231 sec latency 29.565 ms 2026-02-20T02:33:48.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 54711261 844.99 MB/sec execute 231 sec latency 68.733 ms 2026-02-20T02:33:48.919 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:48 trial106 ceph-mon[44052]: pgmap v295: 129 pgs: 129 active+clean; 161 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2026-02-20T02:33:48.920 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:33:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:48 trial098 ceph-mon[38923]: pgmap v295: 129 pgs: 129 active+clean; 161 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 124 op/s 2026-02-20T02:33:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:33:49.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 383547 5.85 MB/sec execute 232 sec latency 29.354 ms 2026-02-20T02:33:49.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 54874631 845.14 MB/sec execute 232 sec latency 7.353 ms 2026-02-20T02:33:50.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 384613 5.85 MB/sec execute 233 sec latency 7.502 ms 2026-02-20T02:33:50.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 55032153 845.23 MB/sec execute 233 sec latency 13.076 ms 2026-02-20T02:33:51.009 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:50 trial098 ceph-mon[38923]: pgmap v296: 129 pgs: 129 active+clean; 162 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2026-02-20T02:33:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:50 trial106 ceph-mon[44052]: pgmap v296: 129 pgs: 129 active+clean; 162 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2026-02-20T02:33:51.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 385873 5.85 MB/sec execute 234 sec latency 7.614 ms 2026-02-20T02:33:51.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 55199026 845.46 MB/sec execute 234 sec latency 0.451 ms 2026-02-20T02:33:52.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 387032 5.86 MB/sec execute 235 sec latency 7.171 ms 2026-02-20T02:33:52.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 55362091 845.60 MB/sec execute 235 sec latency 0.253 ms 2026-02-20T02:33:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:52 trial098 ceph-mon[38923]: pgmap v297: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-20T02:33:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:52 trial106 ceph-mon[44052]: pgmap v297: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-20T02:33:53.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 388059 5.86 MB/sec execute 236 sec latency 7.773 ms 2026-02-20T02:33:53.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 55526274 845.85 MB/sec execute 236 sec latency 0.291 ms 2026-02-20T02:33:54.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 389130 5.84 MB/sec execute 237 sec latency 6.977 ms 2026-02-20T02:33:54.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 55692693 846.06 MB/sec execute 237 sec latency 4.035 ms 2026-02-20T02:33:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:54 trial098 ceph-mon[38923]: pgmap v298: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2026-02-20T02:33:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:54 trial106 ceph-mon[44052]: pgmap v298: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2026-02-20T02:33:55.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 390452 5.86 MB/sec execute 238 sec latency 6.672 ms 2026-02-20T02:33:55.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 55857057 846.24 MB/sec execute 238 sec latency 0.268 ms 2026-02-20T02:33:56.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 391330 5.85 MB/sec execute 239 sec latency 7.801 ms 2026-02-20T02:33:56.362 INFO:tasks.workunit.client.0.trial098.stdout: 1 56018173 846.40 MB/sec execute 239 sec latency 0.263 ms 2026-02-20T02:33:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:56 trial098 ceph-mon[38923]: pgmap v299: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.5 MiB/s wr, 135 op/s 2026-02-20T02:33:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:56 trial106 ceph-mon[44052]: pgmap v299: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.5 MiB/s wr, 135 op/s 2026-02-20T02:33:57.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 392521 5.84 MB/sec execute 240 sec latency 8.282 ms 2026-02-20T02:33:57.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 56185360 846.63 MB/sec execute 240 sec latency 0.543 ms 2026-02-20T02:33:58.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 393724 5.86 MB/sec execute 241 sec latency 7.383 ms 2026-02-20T02:33:58.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 56351422 846.83 MB/sec execute 241 sec latency 0.246 ms 2026-02-20T02:33:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:33:58 trial098 ceph-mon[38923]: pgmap v300: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:33:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:33:58 trial106 ceph-mon[44052]: pgmap v300: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:33:59.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 394639 5.85 MB/sec execute 242 sec latency 8.172 ms 2026-02-20T02:33:59.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 56512754 847.00 MB/sec execute 242 sec latency 0.273 ms 2026-02-20T02:34:00.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 395830 5.85 MB/sec execute 243 sec latency 7.400 ms 2026-02-20T02:34:00.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 56677053 847.15 MB/sec execute 243 sec latency 3.870 ms 2026-02-20T02:34:01.063 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:00 trial098 ceph-mon[38923]: pgmap v301: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 126 op/s 2026-02-20T02:34:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:00 trial106 ceph-mon[44052]: pgmap v301: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 126 op/s 2026-02-20T02:34:01.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 397080 5.86 MB/sec execute 244 sec latency 7.659 ms 2026-02-20T02:34:01.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 56840561 847.36 MB/sec execute 244 sec latency 0.267 ms 2026-02-20T02:34:02.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 398013 5.85 MB/sec execute 245 sec latency 7.295 ms 2026-02-20T02:34:02.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 57007347 847.57 MB/sec execute 245 sec latency 0.258 ms 2026-02-20T02:34:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:02 trial098 ceph-mon[38923]: pgmap v302: 129 pgs: 129 active+clean; 165 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:34:03.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:02 trial106 ceph-mon[44052]: pgmap v302: 129 pgs: 129 active+clean; 165 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:34:03.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 399173 5.85 MB/sec execute 246 sec latency 8.522 ms 2026-02-20T02:34:03.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 57169974 847.69 MB/sec execute 246 sec latency 0.241 ms 2026-02-20T02:34:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:34:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:34:04.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 400592 5.86 MB/sec execute 247 sec latency 12.164 ms 2026-02-20T02:34:04.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 57326838 847.75 MB/sec execute 247 sec latency 18.852 ms 2026-02-20T02:34:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:04 trial098 ceph-mon[38923]: pgmap v303: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 145 op/s 2026-02-20T02:34:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:04 trial106 ceph-mon[44052]: pgmap v303: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 145 op/s 2026-02-20T02:34:05.122 INFO:tasks.workunit.client.1.trial106.stdout: 1 401442 5.86 MB/sec execute 248 sec latency 6.476 ms 2026-02-20T02:34:05.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 57491943 847.93 MB/sec execute 248 sec latency 3.973 ms 2026-02-20T02:34:06.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 402594 5.86 MB/sec execute 249 sec latency 9.475 ms 2026-02-20T02:34:06.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 57652737 848.01 MB/sec execute 249 sec latency 14.784 ms 2026-02-20T02:34:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:06 trial098 ceph-mon[38923]: pgmap v304: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 142 op/s 2026-02-20T02:34:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:06 trial106 ceph-mon[44052]: pgmap v304: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 142 op/s 2026-02-20T02:34:07.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 403862 5.86 MB/sec execute 250 sec latency 7.858 ms 2026-02-20T02:34:07.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 57815467 848.20 MB/sec execute 250 sec latency 0.287 ms 2026-02-20T02:34:08.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 404850 5.87 MB/sec execute 251 sec latency 7.132 ms 2026-02-20T02:34:08.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 57977747 848.29 MB/sec execute 251 sec latency 0.374 ms 2026-02-20T02:34:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:08 trial098 ceph-mon[38923]: pgmap v305: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 117 op/s 2026-02-20T02:34:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:08 trial106 ceph-mon[44052]: pgmap v305: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 117 op/s 2026-02-20T02:34:09.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 405892 5.86 MB/sec execute 252 sec latency 17.795 ms 2026-02-20T02:34:09.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 58088997 847.31 MB/sec execute 252 sec latency 50.383 ms 2026-02-20T02:34:10.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 406736 5.85 MB/sec execute 253 sec latency 33.867 ms 2026-02-20T02:34:10.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 58179282 845.87 MB/sec execute 253 sec latency 66.453 ms 2026-02-20T02:34:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:10 trial098 ceph-mon[38923]: pgmap v306: 129 pgs: 129 active+clean; 169 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2026-02-20T02:34:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:10 trial106 ceph-mon[44052]: pgmap v306: 129 pgs: 129 active+clean; 169 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2026-02-20T02:34:11.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 407926 5.87 MB/sec execute 254 sec latency 7.280 ms 2026-02-20T02:34:11.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 58341307 846.07 MB/sec execute 254 sec latency 4.493 ms 2026-02-20T02:34:12.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 408820 5.85 MB/sec execute 255 sec latency 8.935 ms 2026-02-20T02:34:12.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 58505600 846.22 MB/sec execute 255 sec latency 0.603 ms 2026-02-20T02:34:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:12 trial098 ceph-mon[38923]: pgmap v307: 129 pgs: 129 active+clean; 170 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-20T02:34:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:12 trial106 ceph-mon[44052]: pgmap v307: 129 pgs: 129 active+clean; 170 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-20T02:34:13.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 409952 5.85 MB/sec execute 256 sec latency 7.038 ms 2026-02-20T02:34:13.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 58668283 846.37 MB/sec execute 256 sec latency 0.263 ms 2026-02-20T02:34:14.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 411237 5.86 MB/sec execute 257 sec latency 7.879 ms 2026-02-20T02:34:14.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 58830646 846.51 MB/sec execute 257 sec latency 0.248 ms 2026-02-20T02:34:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:14 trial098 ceph-mon[38923]: pgmap v308: 129 pgs: 129 active+clean; 170 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 135 op/s 2026-02-20T02:34:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:14 trial106 ceph-mon[44052]: pgmap v308: 129 pgs: 129 active+clean; 170 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 135 op/s 2026-02-20T02:34:15.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 411966 5.86 MB/sec execute 258 sec latency 9.127 ms 2026-02-20T02:34:15.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 58990098 846.56 MB/sec execute 258 sec latency 1.680 ms 2026-02-20T02:34:16.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 413059 5.85 MB/sec execute 259 sec latency 8.535 ms 2026-02-20T02:34:16.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 59149763 846.68 MB/sec execute 259 sec latency 0.324 ms 2026-02-20T02:34:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:16 trial098 ceph-mon[38923]: pgmap v309: 129 pgs: 129 active+clean; 172 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 108 op/s 2026-02-20T02:34:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:16 trial106 ceph-mon[44052]: pgmap v309: 129 pgs: 129 active+clean; 172 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.4 MiB/s wr, 108 op/s 2026-02-20T02:34:17.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 414273 5.85 MB/sec execute 260 sec latency 9.570 ms 2026-02-20T02:34:17.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 59311011 846.78 MB/sec execute 260 sec latency 0.237 ms 2026-02-20T02:34:18.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 415361 5.86 MB/sec execute 261 sec latency 7.735 ms 2026-02-20T02:34:18.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 59473821 846.89 MB/sec execute 261 sec latency 0.389 ms 2026-02-20T02:34:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:18 trial098 ceph-mon[38923]: pgmap v310: 129 pgs: 129 active+clean; 174 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2026-02-20T02:34:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:34:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:18 trial106 ceph-mon[44052]: pgmap v310: 129 pgs: 129 active+clean; 174 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2026-02-20T02:34:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:34:19.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 416268 5.85 MB/sec execute 262 sec latency 8.649 ms 2026-02-20T02:34:19.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 59631754 846.97 MB/sec execute 262 sec latency 9.886 ms 2026-02-20T02:34:20.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 417459 5.84 MB/sec execute 263 sec latency 7.960 ms 2026-02-20T02:34:20.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 59796497 847.12 MB/sec execute 263 sec latency 0.263 ms 2026-02-20T02:34:20.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:20 trial098 ceph-mon[38923]: pgmap v311: 129 pgs: 129 active+clean; 172 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.4 MiB/s wr, 131 op/s 2026-02-20T02:34:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:20 trial106 ceph-mon[44052]: pgmap v311: 129 pgs: 129 active+clean; 172 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.4 MiB/s wr, 131 op/s 2026-02-20T02:34:21.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 418723 5.86 MB/sec execute 264 sec latency 7.963 ms 2026-02-20T02:34:21.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 59960131 847.26 MB/sec execute 264 sec latency 5.946 ms 2026-02-20T02:34:22.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 419630 5.85 MB/sec execute 265 sec latency 7.688 ms 2026-02-20T02:34:22.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 60123606 847.45 MB/sec execute 265 sec latency 0.264 ms 2026-02-20T02:34:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:22 trial098 ceph-mon[38923]: pgmap v312: 129 pgs: 129 active+clean; 172 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 121 op/s 2026-02-20T02:34:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:22 trial106 ceph-mon[44052]: pgmap v312: 129 pgs: 129 active+clean; 172 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 121 op/s 2026-02-20T02:34:23.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 420759 5.84 MB/sec execute 266 sec latency 9.010 ms 2026-02-20T02:34:23.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 60283751 847.52 MB/sec execute 266 sec latency 0.255 ms 2026-02-20T02:34:24.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 421919 5.86 MB/sec execute 267 sec latency 8.143 ms 2026-02-20T02:34:24.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 60445908 847.61 MB/sec execute 267 sec latency 0.240 ms 2026-02-20T02:34:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:24 trial098 ceph-mon[38923]: pgmap v313: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-20T02:34:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:24 trial106 ceph-mon[44052]: pgmap v313: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-20T02:34:25.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 422912 5.85 MB/sec execute 268 sec latency 8.665 ms 2026-02-20T02:34:25.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 60605062 847.72 MB/sec execute 268 sec latency 0.348 ms 2026-02-20T02:34:25.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:34:25.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:34:25.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:34:25.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:34:26.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:34:26.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:34:26.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:34:26.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:34:26.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 424025 5.85 MB/sec execute 269 sec latency 7.990 ms 2026-02-20T02:34:26.363 INFO:tasks.workunit.client.0.trial098.stdout: 1 60766935 847.81 MB/sec execute 269 sec latency 9.302 ms 2026-02-20T02:34:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:26 trial098 ceph-mon[38923]: pgmap v314: 129 pgs: 129 active+clean; 176 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-20T02:34:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:26 trial106 ceph-mon[44052]: pgmap v314: 129 pgs: 129 active+clean; 176 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-20T02:34:27.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 425411 5.86 MB/sec execute 270 sec latency 7.502 ms 2026-02-20T02:34:27.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 60930839 847.95 MB/sec execute 270 sec latency 0.258 ms 2026-02-20T02:34:28.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 426246 5.86 MB/sec execute 271 sec latency 6.700 ms 2026-02-20T02:34:28.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 61093778 848.12 MB/sec execute 271 sec latency 0.259 ms 2026-02-20T02:34:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:28 trial098 ceph-mon[38923]: pgmap v315: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 3.0 MiB/s wr, 148 op/s 2026-02-20T02:34:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:28 trial106 ceph-mon[44052]: pgmap v315: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 3.0 MiB/s wr, 148 op/s 2026-02-20T02:34:29.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 427413 5.85 MB/sec execute 272 sec latency 7.369 ms 2026-02-20T02:34:29.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 61260284 848.29 MB/sec execute 272 sec latency 0.281 ms 2026-02-20T02:34:30.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 428684 5.86 MB/sec execute 273 sec latency 6.811 ms 2026-02-20T02:34:30.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 61421018 848.43 MB/sec execute 273 sec latency 0.281 ms 2026-02-20T02:34:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:30 trial098 ceph-mon[38923]: pgmap v316: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-20T02:34:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:30 trial106 ceph-mon[44052]: pgmap v316: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-20T02:34:31.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 429617 5.86 MB/sec execute 274 sec latency 38.173 ms 2026-02-20T02:34:31.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 61574767 848.36 MB/sec execute 274 sec latency 58.844 ms 2026-02-20T02:34:32.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 430646 5.86 MB/sec execute 275 sec latency 8.278 ms 2026-02-20T02:34:32.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 61741581 848.54 MB/sec execute 275 sec latency 0.323 ms 2026-02-20T02:34:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:32 trial098 ceph-mon[38923]: pgmap v317: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 139 op/s 2026-02-20T02:34:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:32 trial106 ceph-mon[44052]: pgmap v317: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 3.0 MiB/s wr, 139 op/s 2026-02-20T02:34:33.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 431772 5.85 MB/sec execute 276 sec latency 9.305 ms 2026-02-20T02:34:33.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 61904279 848.71 MB/sec execute 276 sec latency 0.377 ms 2026-02-20T02:34:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:34:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:34:34.123 INFO:tasks.workunit.client.1.trial106.stdout: 1 433013 5.87 MB/sec execute 277 sec latency 7.281 ms 2026-02-20T02:34:34.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 62069693 848.86 MB/sec execute 277 sec latency 0.457 ms 2026-02-20T02:34:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:34 trial098 ceph-mon[38923]: pgmap v318: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-20T02:34:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:34 trial106 ceph-mon[44052]: pgmap v318: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-20T02:34:35.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 433862 5.85 MB/sec execute 278 sec latency 7.269 ms 2026-02-20T02:34:35.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 62232063 848.96 MB/sec execute 278 sec latency 4.418 ms 2026-02-20T02:34:36.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 434812 5.85 MB/sec execute 279 sec latency 33.787 ms 2026-02-20T02:34:36.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 62285074 846.94 MB/sec execute 279 sec latency 67.149 ms 2026-02-20T02:34:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:36 trial098 ceph-mon[38923]: pgmap v319: 129 pgs: 129 active+clean; 181 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-20T02:34:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:36 trial106 ceph-mon[44052]: pgmap v319: 129 pgs: 129 active+clean; 181 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-20T02:34:37.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 435929 5.85 MB/sec execute 280 sec latency 36.332 ms 2026-02-20T02:34:37.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 62413626 846.45 MB/sec execute 280 sec latency 50.977 ms 2026-02-20T02:34:38.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 436785 5.85 MB/sec execute 281 sec latency 7.761 ms 2026-02-20T02:34:38.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 62579771 846.63 MB/sec execute 281 sec latency 0.238 ms 2026-02-20T02:34:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:38 trial098 ceph-mon[38923]: pgmap v320: 129 pgs: 129 active+clean; 180 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 129 op/s 2026-02-20T02:34:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:38 trial106 ceph-mon[44052]: pgmap v320: 129 pgs: 129 active+clean; 180 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 129 op/s 2026-02-20T02:34:39.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 437871 5.85 MB/sec execute 282 sec latency 7.981 ms 2026-02-20T02:34:39.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 62747704 846.84 MB/sec execute 282 sec latency 0.256 ms 2026-02-20T02:34:40.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 439063 5.85 MB/sec execute 283 sec latency 7.401 ms 2026-02-20T02:34:40.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 62909061 846.97 MB/sec execute 283 sec latency 0.283 ms 2026-02-20T02:34:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:40 trial098 ceph-mon[38923]: pgmap v321: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.3 MiB/s wr, 106 op/s 2026-02-20T02:34:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:40 trial106 ceph-mon[44052]: pgmap v321: 129 pgs: 129 active+clean; 179 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.3 MiB/s wr, 106 op/s 2026-02-20T02:34:41.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 440178 5.86 MB/sec execute 284 sec latency 7.003 ms 2026-02-20T02:34:41.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 63073724 847.13 MB/sec execute 284 sec latency 0.312 ms 2026-02-20T02:34:42.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 441139 5.84 MB/sec execute 285 sec latency 8.232 ms 2026-02-20T02:34:42.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 63238020 847.26 MB/sec execute 285 sec latency 0.821 ms 2026-02-20T02:34:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:42 trial098 ceph-mon[38923]: pgmap v322: 129 pgs: 129 active+clean; 182 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:34:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:42 trial106 ceph-mon[44052]: pgmap v322: 129 pgs: 129 active+clean; 182 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-20T02:34:43.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 442267 5.84 MB/sec execute 286 sec latency 7.467 ms 2026-02-20T02:34:43.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 63398569 847.38 MB/sec execute 286 sec latency 0.305 ms 2026-02-20T02:34:44.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 443521 5.86 MB/sec execute 287 sec latency 7.040 ms 2026-02-20T02:34:44.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 63560761 847.47 MB/sec execute 287 sec latency 0.283 ms 2026-02-20T02:34:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:44 trial098 ceph-mon[38923]: pgmap v323: 129 pgs: 129 active+clean; 182 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 120 op/s 2026-02-20T02:34:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:44 trial106 ceph-mon[44052]: pgmap v323: 129 pgs: 129 active+clean; 182 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 120 op/s 2026-02-20T02:34:45.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 444345 5.85 MB/sec execute 288 sec latency 24.371 ms 2026-02-20T02:34:45.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 63724935 847.66 MB/sec execute 288 sec latency 0.267 ms 2026-02-20T02:34:46.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 445511 5.84 MB/sec execute 289 sec latency 7.541 ms 2026-02-20T02:34:46.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 63891040 847.83 MB/sec execute 289 sec latency 4.542 ms 2026-02-20T02:34:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:46 trial098 ceph-mon[38923]: pgmap v324: 129 pgs: 129 active+clean; 184 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2026-02-20T02:34:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:46 trial106 ceph-mon[44052]: pgmap v324: 129 pgs: 129 active+clean; 184 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2026-02-20T02:34:47.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 446721 5.85 MB/sec execute 290 sec latency 8.054 ms 2026-02-20T02:34:47.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 64059112 848.03 MB/sec execute 290 sec latency 0.244 ms 2026-02-20T02:34:48.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 447612 5.85 MB/sec execute 291 sec latency 6.895 ms 2026-02-20T02:34:48.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 64222132 848.19 MB/sec execute 291 sec latency 0.312 ms 2026-02-20T02:34:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:48 trial098 ceph-mon[38923]: pgmap v325: 129 pgs: 129 active+clean; 184 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.0 KiB/s rd, 2.6 MiB/s wr, 118 op/s 2026-02-20T02:34:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:34:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:48 trial106 ceph-mon[44052]: pgmap v325: 129 pgs: 129 active+clean; 184 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.0 KiB/s rd, 2.6 MiB/s wr, 118 op/s 2026-02-20T02:34:49.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:34:49.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 448774 5.85 MB/sec execute 292 sec latency 7.667 ms 2026-02-20T02:34:49.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 64386283 848.32 MB/sec execute 292 sec latency 0.238 ms 2026-02-20T02:34:50.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 449975 5.85 MB/sec execute 293 sec latency 7.301 ms 2026-02-20T02:34:50.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 64551437 848.47 MB/sec execute 293 sec latency 4.259 ms 2026-02-20T02:34:51.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:50 trial098 ceph-mon[38923]: pgmap v326: 129 pgs: 129 active+clean; 185 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.5 MiB/s wr, 120 op/s 2026-02-20T02:34:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:50 trial106 ceph-mon[44052]: pgmap v326: 129 pgs: 129 active+clean; 185 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.5 MiB/s wr, 120 op/s 2026-02-20T02:34:51.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 450957 5.85 MB/sec execute 294 sec latency 7.411 ms 2026-02-20T02:34:51.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 64712188 848.59 MB/sec execute 294 sec latency 0.282 ms 2026-02-20T02:34:52.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 452077 5.85 MB/sec execute 295 sec latency 7.419 ms 2026-02-20T02:34:52.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 64879274 848.76 MB/sec execute 295 sec latency 3.688 ms 2026-02-20T02:34:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:52 trial098 ceph-mon[38923]: pgmap v327: 129 pgs: 129 active+clean; 186 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 3.0 MiB/s wr, 133 op/s 2026-02-20T02:34:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:52 trial106 ceph-mon[44052]: pgmap v327: 129 pgs: 129 active+clean; 186 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 3.0 MiB/s wr, 133 op/s 2026-02-20T02:34:53.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 453366 5.85 MB/sec execute 296 sec latency 8.413 ms 2026-02-20T02:34:53.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 65046618 848.94 MB/sec execute 296 sec latency 0.265 ms 2026-02-20T02:34:54.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 454378 5.86 MB/sec execute 297 sec latency 6.803 ms 2026-02-20T02:34:54.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 65209969 849.10 MB/sec execute 297 sec latency 0.296 ms 2026-02-20T02:34:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:54 trial098 ceph-mon[38923]: pgmap v328: 129 pgs: 129 active+clean; 187 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-20T02:34:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:54 trial106 ceph-mon[44052]: pgmap v328: 129 pgs: 129 active+clean; 187 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-20T02:34:55.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 455300 5.85 MB/sec execute 298 sec latency 8.398 ms 2026-02-20T02:34:55.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 65372961 849.20 MB/sec execute 298 sec latency 0.249 ms 2026-02-20T02:34:56.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 456431 5.84 MB/sec execute 299 sec latency 7.861 ms 2026-02-20T02:34:56.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 65535784 849.30 MB/sec execute 299 sec latency 0.253 ms 2026-02-20T02:34:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:56 trial098 ceph-mon[38923]: pgmap v329: 129 pgs: 129 active+clean; 188 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 130 op/s 2026-02-20T02:34:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:56 trial106 ceph-mon[44052]: pgmap v329: 129 pgs: 129 active+clean; 188 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 130 op/s 2026-02-20T02:34:57.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 457722 5.86 MB/sec execute 300 sec latency 7.116 ms 2026-02-20T02:34:57.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 65690427 849.30 MB/sec execute 300 sec latency 57.206 ms 2026-02-20T02:34:58.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 458435 5.86 MB/sec execute 301 sec latency 32.048 ms 2026-02-20T02:34:58.364 INFO:tasks.workunit.client.0.trial098.stdout: 1 65854415 849.41 MB/sec execute 301 sec latency 0.265 ms 2026-02-20T02:34:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:34:58 trial098 ceph-mon[38923]: pgmap v330: 129 pgs: 129 active+clean; 190 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 128 op/s 2026-02-20T02:34:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:34:58 trial106 ceph-mon[44052]: pgmap v330: 129 pgs: 129 active+clean; 190 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 128 op/s 2026-02-20T02:34:59.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 459831 5.91 MB/sec execute 302 sec latency 8.048 ms 2026-02-20T02:34:59.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 66018990 849.60 MB/sec execute 302 sec latency 0.341 ms 2026-02-20T02:35:00.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 460962 5.90 MB/sec execute 303 sec latency 9.136 ms 2026-02-20T02:35:00.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 66181319 849.68 MB/sec execute 303 sec latency 2.563 ms 2026-02-20T02:35:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:00 trial098 ceph-mon[38923]: pgmap v331: 129 pgs: 129 active+clean; 195 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 3.1 MiB/s wr, 138 op/s 2026-02-20T02:35:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:00 trial106 ceph-mon[44052]: pgmap v331: 129 pgs: 129 active+clean; 195 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 3.1 MiB/s wr, 138 op/s 2026-02-20T02:35:01.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 462222 5.92 MB/sec execute 304 sec latency 7.077 ms 2026-02-20T02:35:01.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 66340860 849.71 MB/sec execute 304 sec latency 1.467 ms 2026-02-20T02:35:02.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 463191 5.91 MB/sec execute 305 sec latency 7.870 ms 2026-02-20T02:35:02.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 66485678 849.55 MB/sec execute 305 sec latency 47.783 ms 2026-02-20T02:35:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:02 trial098 ceph-mon[38923]: pgmap v332: 129 pgs: 129 active+clean; 194 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 3.5 MiB/s wr, 142 op/s 2026-02-20T02:35:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:02 trial106 ceph-mon[44052]: pgmap v332: 129 pgs: 129 active+clean; 194 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 3.5 MiB/s wr, 142 op/s 2026-02-20T02:35:03.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 464002 5.90 MB/sec execute 306 sec latency 31.868 ms 2026-02-20T02:35:03.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 66517948 847.34 MB/sec execute 306 sec latency 67.970 ms 2026-02-20T02:35:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:35:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:35:04.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 465219 5.91 MB/sec execute 307 sec latency 29.449 ms 2026-02-20T02:35:04.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 66681333 847.45 MB/sec execute 307 sec latency 0.240 ms 2026-02-20T02:35:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:04 trial098 ceph-mon[38923]: pgmap v333: 129 pgs: 129 active+clean; 191 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 4.1 MiB/s wr, 143 op/s 2026-02-20T02:35:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:04 trial106 ceph-mon[44052]: pgmap v333: 129 pgs: 129 active+clean; 191 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 4.1 MiB/s wr, 143 op/s 2026-02-20T02:35:05.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 466065 5.90 MB/sec execute 308 sec latency 7.081 ms 2026-02-20T02:35:05.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 66845077 847.56 MB/sec execute 308 sec latency 0.731 ms 2026-02-20T02:35:06.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 467221 5.90 MB/sec execute 309 sec latency 7.817 ms 2026-02-20T02:35:06.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 67008108 847.72 MB/sec execute 309 sec latency 0.291 ms 2026-02-20T02:35:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:06 trial098 ceph-mon[38923]: pgmap v334: 129 pgs: 129 active+clean; 191 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 4.1 MiB/s wr, 141 op/s 2026-02-20T02:35:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:06 trial106 ceph-mon[44052]: pgmap v334: 129 pgs: 129 active+clean; 191 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 4.1 MiB/s wr, 141 op/s 2026-02-20T02:35:07.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 468339 5.90 MB/sec execute 310 sec latency 8.293 ms 2026-02-20T02:35:07.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 67168069 847.77 MB/sec execute 310 sec latency 0.252 ms 2026-02-20T02:35:08.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 469331 5.91 MB/sec execute 311 sec latency 7.139 ms 2026-02-20T02:35:08.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 67330486 847.86 MB/sec execute 311 sec latency 6.577 ms 2026-02-20T02:35:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:08 trial098 ceph-mon[38923]: pgmap v335: 129 pgs: 129 active+clean; 191 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 4.0 MiB/s wr, 136 op/s 2026-02-20T02:35:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:08 trial106 ceph-mon[44052]: pgmap v335: 129 pgs: 129 active+clean; 191 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 4.0 MiB/s wr, 136 op/s 2026-02-20T02:35:09.124 INFO:tasks.workunit.client.1.trial106.stdout: 1 470214 5.90 MB/sec execute 312 sec latency 38.575 ms 2026-02-20T02:35:09.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 67464162 847.50 MB/sec execute 312 sec latency 66.177 ms 2026-02-20T02:35:10.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 471438 5.89 MB/sec execute 313 sec latency 7.017 ms 2026-02-20T02:35:10.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 67630511 847.66 MB/sec execute 313 sec latency 0.252 ms 2026-02-20T02:35:11.063 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:10 trial098 ceph-mon[38923]: pgmap v336: 129 pgs: 129 active+clean; 193 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 4.1 MiB/s wr, 139 op/s 2026-02-20T02:35:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:10 trial106 ceph-mon[44052]: pgmap v336: 129 pgs: 129 active+clean; 193 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 4.1 MiB/s wr, 139 op/s 2026-02-20T02:35:11.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 472773 5.91 MB/sec execute 314 sec latency 7.243 ms 2026-02-20T02:35:11.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 67795293 847.80 MB/sec execute 314 sec latency 0.247 ms 2026-02-20T02:35:12.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 473654 5.90 MB/sec execute 315 sec latency 7.747 ms 2026-02-20T02:35:12.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 67955172 847.89 MB/sec execute 315 sec latency 0.283 ms 2026-02-20T02:35:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:12 trial098 ceph-mon[38923]: pgmap v337: 129 pgs: 129 active+clean; 193 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.6 MiB/s wr, 131 op/s 2026-02-20T02:35:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:12 trial106 ceph-mon[44052]: pgmap v337: 129 pgs: 129 active+clean; 193 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.6 MiB/s wr, 131 op/s 2026-02-20T02:35:13.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 474866 5.90 MB/sec execute 316 sec latency 7.499 ms 2026-02-20T02:35:13.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 68117305 847.97 MB/sec execute 316 sec latency 0.280 ms 2026-02-20T02:35:14.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 476091 5.91 MB/sec execute 317 sec latency 30.319 ms 2026-02-20T02:35:14.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 68248194 847.52 MB/sec execute 317 sec latency 40.255 ms 2026-02-20T02:35:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:14 trial098 ceph-mon[38923]: pgmap v338: 129 pgs: 129 active+clean; 194 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.4 MiB/s wr, 129 op/s 2026-02-20T02:35:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:14 trial106 ceph-mon[44052]: pgmap v338: 129 pgs: 129 active+clean; 194 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.4 MiB/s wr, 129 op/s 2026-02-20T02:35:15.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 476952 5.90 MB/sec execute 318 sec latency 34.101 ms 2026-02-20T02:35:15.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 68413030 847.70 MB/sec execute 318 sec latency 0.309 ms 2026-02-20T02:35:16.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 478127 5.90 MB/sec execute 319 sec latency 7.863 ms 2026-02-20T02:35:16.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 68579346 847.85 MB/sec execute 319 sec latency 0.255 ms 2026-02-20T02:35:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:16 trial098 ceph-mon[38923]: pgmap v339: 129 pgs: 129 active+clean; 196 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.7 MiB/s wr, 140 op/s 2026-02-20T02:35:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:16 trial106 ceph-mon[44052]: pgmap v339: 129 pgs: 129 active+clean; 196 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.7 MiB/s wr, 140 op/s 2026-02-20T02:35:17.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 479439 5.91 MB/sec execute 320 sec latency 7.523 ms 2026-02-20T02:35:17.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 68741195 847.94 MB/sec execute 320 sec latency 5.092 ms 2026-02-20T02:35:18.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 480350 5.90 MB/sec execute 321 sec latency 9.368 ms 2026-02-20T02:35:18.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 68906628 848.12 MB/sec execute 321 sec latency 0.273 ms 2026-02-20T02:35:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:18 trial098 ceph-mon[38923]: pgmap v340: 129 pgs: 129 active+clean; 196 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2026-02-20T02:35:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:35:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:18 trial106 ceph-mon[44052]: pgmap v340: 129 pgs: 129 active+clean; 196 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2026-02-20T02:35:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:35:19.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 481532 5.90 MB/sec execute 322 sec latency 7.764 ms 2026-02-20T02:35:19.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 69071535 848.26 MB/sec execute 322 sec latency 0.497 ms 2026-02-20T02:35:20.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 482663 5.91 MB/sec execute 323 sec latency 27.660 ms 2026-02-20T02:35:20.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 69200848 847.78 MB/sec execute 323 sec latency 60.263 ms 2026-02-20T02:35:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:20 trial098 ceph-mon[38923]: pgmap v341: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 3.1 MiB/s wr, 143 op/s 2026-02-20T02:35:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:20 trial106 ceph-mon[44052]: pgmap v341: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 3.1 MiB/s wr, 143 op/s 2026-02-20T02:35:21.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 483686 5.91 MB/sec execute 324 sec latency 6.568 ms 2026-02-20T02:35:21.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 69363165 847.92 MB/sec execute 324 sec latency 2.861 ms 2026-02-20T02:35:22.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 484777 5.91 MB/sec execute 325 sec latency 6.810 ms 2026-02-20T02:35:22.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 69526992 848.03 MB/sec execute 325 sec latency 0.351 ms 2026-02-20T02:35:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:22 trial098 ceph-mon[38923]: pgmap v342: 129 pgs: 129 active+clean; 199 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-20T02:35:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:22 trial106 ceph-mon[44052]: pgmap v342: 129 pgs: 129 active+clean; 199 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-20T02:35:23.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 485972 5.91 MB/sec execute 326 sec latency 7.678 ms 2026-02-20T02:35:23.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 69689921 848.18 MB/sec execute 326 sec latency 6.220 ms 2026-02-20T02:35:24.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 487099 5.91 MB/sec execute 327 sec latency 7.823 ms 2026-02-20T02:35:24.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 69855192 848.30 MB/sec execute 327 sec latency 0.290 ms 2026-02-20T02:35:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:24 trial098 ceph-mon[38923]: pgmap v343: 129 pgs: 129 active+clean; 199 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-20T02:35:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:24 trial106 ceph-mon[44052]: pgmap v343: 129 pgs: 129 active+clean; 199 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-20T02:35:25.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 488018 5.90 MB/sec execute 328 sec latency 7.409 ms 2026-02-20T02:35:25.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 70019230 848.42 MB/sec execute 328 sec latency 0.285 ms 2026-02-20T02:35:26.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:35:26.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:35:26.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:25 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:35:26.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:35:26.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:35:26.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:25 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:35:26.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 489175 5.90 MB/sec execute 329 sec latency 7.503 ms 2026-02-20T02:35:26.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 70175794 848.46 MB/sec execute 329 sec latency 1.033 ms 2026-02-20T02:35:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:26 trial098 ceph-mon[38923]: pgmap v344: 129 pgs: 129 active+clean; 201 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.8 MiB/s wr, 151 op/s 2026-02-20T02:35:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:35:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:35:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:35:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:26 trial106 ceph-mon[44052]: pgmap v344: 129 pgs: 129 active+clean; 201 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.8 MiB/s wr, 151 op/s 2026-02-20T02:35:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:35:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:35:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:35:27.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 490510 5.92 MB/sec execute 330 sec latency 7.301 ms 2026-02-20T02:35:27.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 70337557 848.53 MB/sec execute 330 sec latency 0.283 ms 2026-02-20T02:35:28.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 491363 5.90 MB/sec execute 331 sec latency 8.074 ms 2026-02-20T02:35:28.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 70499542 848.61 MB/sec execute 331 sec latency 8.873 ms 2026-02-20T02:35:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:28 trial098 ceph-mon[38923]: pgmap v345: 129 pgs: 129 active+clean; 199 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.4 MiB/s wr, 125 op/s 2026-02-20T02:35:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:28 trial106 ceph-mon[44052]: pgmap v345: 129 pgs: 129 active+clean; 199 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.4 MiB/s wr, 125 op/s 2026-02-20T02:35:29.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 492508 5.90 MB/sec execute 332 sec latency 7.202 ms 2026-02-20T02:35:29.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 70662870 848.75 MB/sec execute 332 sec latency 0.396 ms 2026-02-20T02:35:30.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 493700 5.91 MB/sec execute 333 sec latency 7.129 ms 2026-02-20T02:35:30.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 70829237 848.89 MB/sec execute 333 sec latency 0.271 ms 2026-02-20T02:35:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:30 trial098 ceph-mon[38923]: pgmap v346: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-20T02:35:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:30 trial106 ceph-mon[44052]: pgmap v346: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-20T02:35:31.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 494726 5.91 MB/sec execute 334 sec latency 7.412 ms 2026-02-20T02:35:31.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 70991721 848.97 MB/sec execute 334 sec latency 2.149 ms 2026-02-20T02:35:32.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 495898 5.90 MB/sec execute 335 sec latency 9.397 ms 2026-02-20T02:35:32.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 71155608 849.12 MB/sec execute 335 sec latency 4.685 ms 2026-02-20T02:35:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:32 trial098 ceph-mon[38923]: pgmap v347: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:35:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:32 trial106 ceph-mon[44052]: pgmap v347: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:35:33.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 497155 5.91 MB/sec execute 336 sec latency 7.917 ms 2026-02-20T02:35:33.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 71323306 849.29 MB/sec execute 336 sec latency 2.676 ms 2026-02-20T02:35:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:35:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:35:34.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 497981 5.91 MB/sec execute 337 sec latency 6.915 ms 2026-02-20T02:35:34.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 71490018 849.44 MB/sec execute 337 sec latency 0.268 ms 2026-02-20T02:35:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:34 trial098 ceph-mon[38923]: pgmap v348: 129 pgs: 129 active+clean; 204 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-20T02:35:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:34 trial106 ceph-mon[44052]: pgmap v348: 129 pgs: 129 active+clean; 204 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-20T02:35:35.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 499086 5.91 MB/sec execute 338 sec latency 9.510 ms 2026-02-20T02:35:35.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 71653432 849.58 MB/sec execute 338 sec latency 0.338 ms 2026-02-20T02:35:36.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 500324 5.91 MB/sec execute 339 sec latency 27.037 ms 2026-02-20T02:35:36.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 71806043 849.50 MB/sec execute 339 sec latency 54.174 ms 2026-02-20T02:35:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:36 trial098 ceph-mon[38923]: pgmap v349: 129 pgs: 129 active+clean; 204 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2026-02-20T02:35:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:36 trial106 ceph-mon[44052]: pgmap v349: 129 pgs: 129 active+clean; 204 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2026-02-20T02:35:37.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 501308 5.91 MB/sec execute 340 sec latency 8.504 ms 2026-02-20T02:35:37.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 71966135 849.59 MB/sec execute 340 sec latency 0.588 ms 2026-02-20T02:35:38.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 502329 5.91 MB/sec execute 341 sec latency 6.956 ms 2026-02-20T02:35:38.365 INFO:tasks.workunit.client.0.trial098.stdout: 1 72134754 849.77 MB/sec execute 341 sec latency 9.243 ms 2026-02-20T02:35:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:38 trial098 ceph-mon[38923]: pgmap v350: 129 pgs: 129 active+clean; 207 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 130 op/s 2026-02-20T02:35:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:38 trial106 ceph-mon[44052]: pgmap v350: 129 pgs: 129 active+clean; 207 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 130 op/s 2026-02-20T02:35:39.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 503413 5.90 MB/sec execute 342 sec latency 8.129 ms 2026-02-20T02:35:39.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 72298671 849.87 MB/sec execute 342 sec latency 0.252 ms 2026-02-20T02:35:40.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 504607 5.91 MB/sec execute 343 sec latency 8.809 ms 2026-02-20T02:35:40.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 72461073 850.00 MB/sec execute 343 sec latency 0.296 ms 2026-02-20T02:35:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:40 trial098 ceph-mon[38923]: pgmap v351: 129 pgs: 129 active+clean; 206 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 3.1 MiB/s wr, 134 op/s 2026-02-20T02:35:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:40 trial106 ceph-mon[44052]: pgmap v351: 129 pgs: 129 active+clean; 206 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 3.1 MiB/s wr, 134 op/s 2026-02-20T02:35:41.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 505247 5.90 MB/sec execute 344 sec latency 26.786 ms 2026-02-20T02:35:41.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 72514852 848.36 MB/sec execute 344 sec latency 66.447 ms 2026-02-20T02:35:42.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 506296 5.90 MB/sec execute 345 sec latency 36.349 ms 2026-02-20T02:35:42.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 72674087 848.40 MB/sec execute 345 sec latency 30.557 ms 2026-02-20T02:35:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:42 trial098 ceph-mon[38923]: pgmap v352: 129 pgs: 129 active+clean; 205 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 135 op/s 2026-02-20T02:35:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:42 trial106 ceph-mon[44052]: pgmap v352: 129 pgs: 129 active+clean; 205 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 135 op/s 2026-02-20T02:35:43.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 507518 5.90 MB/sec execute 346 sec latency 7.537 ms 2026-02-20T02:35:43.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 72839384 848.51 MB/sec execute 346 sec latency 0.273 ms 2026-02-20T02:35:44.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 508507 5.90 MB/sec execute 347 sec latency 6.653 ms 2026-02-20T02:35:44.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 73002677 848.66 MB/sec execute 347 sec latency 0.262 ms 2026-02-20T02:35:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:44 trial098 ceph-mon[38923]: pgmap v353: 129 pgs: 129 active+clean; 205 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-20T02:35:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:44 trial106 ceph-mon[44052]: pgmap v353: 129 pgs: 129 active+clean; 205 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-20T02:35:45.125 INFO:tasks.workunit.client.1.trial106.stdout: 1 509646 5.90 MB/sec execute 348 sec latency 8.134 ms 2026-02-20T02:35:45.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 73164705 848.73 MB/sec execute 348 sec latency 0.267 ms 2026-02-20T02:35:46.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 510908 5.90 MB/sec execute 349 sec latency 7.775 ms 2026-02-20T02:35:46.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 73324375 848.76 MB/sec execute 349 sec latency 0.258 ms 2026-02-20T02:35:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:46 trial098 ceph-mon[38923]: pgmap v354: 129 pgs: 129 active+clean; 208 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:35:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:46 trial106 ceph-mon[44052]: pgmap v354: 129 pgs: 129 active+clean; 208 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:35:47.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 511966 5.91 MB/sec execute 350 sec latency 6.914 ms 2026-02-20T02:35:47.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 73485219 848.86 MB/sec execute 350 sec latency 0.297 ms 2026-02-20T02:35:48.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 513004 5.90 MB/sec execute 351 sec latency 7.872 ms 2026-02-20T02:35:48.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 73644331 848.89 MB/sec execute 351 sec latency 12.167 ms 2026-02-20T02:35:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:48 trial098 ceph-mon[38923]: pgmap v355: 129 pgs: 129 active+clean; 208 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:35:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:35:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:48 trial106 ceph-mon[44052]: pgmap v355: 129 pgs: 129 active+clean; 208 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:35:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:35:49.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 514152 5.90 MB/sec execute 352 sec latency 7.645 ms 2026-02-20T02:35:49.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 73808206 849.04 MB/sec execute 352 sec latency 0.347 ms 2026-02-20T02:35:50.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 515373 5.91 MB/sec execute 353 sec latency 7.338 ms 2026-02-20T02:35:50.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 73971482 849.13 MB/sec execute 353 sec latency 0.261 ms 2026-02-20T02:35:51.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:50 trial098 ceph-mon[38923]: pgmap v356: 129 pgs: 129 active+clean; 209 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 105 op/s 2026-02-20T02:35:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:50 trial106 ceph-mon[44052]: pgmap v356: 129 pgs: 129 active+clean; 209 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 105 op/s 2026-02-20T02:35:51.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 516215 5.90 MB/sec execute 354 sec latency 8.885 ms 2026-02-20T02:35:51.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 74131087 849.16 MB/sec execute 354 sec latency 0.248 ms 2026-02-20T02:35:52.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 517317 5.89 MB/sec execute 355 sec latency 8.674 ms 2026-02-20T02:35:52.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 74291162 849.25 MB/sec execute 355 sec latency 4.999 ms 2026-02-20T02:35:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:52 trial098 ceph-mon[38923]: pgmap v357: 129 pgs: 129 active+clean; 198 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 124 op/s 2026-02-20T02:35:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:52 trial106 ceph-mon[44052]: pgmap v357: 129 pgs: 129 active+clean; 198 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 124 op/s 2026-02-20T02:35:53.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 518454 5.90 MB/sec execute 356 sec latency 9.229 ms 2026-02-20T02:35:53.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 74450946 849.28 MB/sec execute 356 sec latency 0.674 ms 2026-02-20T02:35:54.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 519365 5.90 MB/sec execute 357 sec latency 7.724 ms 2026-02-20T02:35:54.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 74612439 849.33 MB/sec execute 357 sec latency 0.257 ms 2026-02-20T02:35:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:54 trial098 ceph-mon[38923]: pgmap v358: 129 pgs: 129 active+clean; 194 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 122 op/s 2026-02-20T02:35:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:54 trial106 ceph-mon[44052]: pgmap v358: 129 pgs: 129 active+clean; 194 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 122 op/s 2026-02-20T02:35:55.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 520493 5.90 MB/sec execute 358 sec latency 7.953 ms 2026-02-20T02:35:55.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 74774407 849.46 MB/sec execute 358 sec latency 0.266 ms 2026-02-20T02:35:56.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 521685 5.90 MB/sec execute 359 sec latency 7.580 ms 2026-02-20T02:35:56.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 74934469 849.49 MB/sec execute 359 sec latency 0.237 ms 2026-02-20T02:35:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:56 trial098 ceph-mon[38923]: pgmap v359: 129 pgs: 129 active+clean; 188 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.8 MiB/s wr, 140 op/s 2026-02-20T02:35:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:56 trial106 ceph-mon[44052]: pgmap v359: 129 pgs: 129 active+clean; 188 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.8 MiB/s wr, 140 op/s 2026-02-20T02:35:57.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 522625 5.90 MB/sec execute 360 sec latency 7.504 ms 2026-02-20T02:35:57.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 75095547 849.54 MB/sec execute 360 sec latency 0.550 ms 2026-02-20T02:35:58.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 523673 5.90 MB/sec execute 361 sec latency 8.033 ms 2026-02-20T02:35:58.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 75254516 849.61 MB/sec execute 361 sec latency 5.019 ms 2026-02-20T02:35:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:35:58 trial098 ceph-mon[38923]: pgmap v360: 129 pgs: 129 active+clean; 187 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 113 op/s 2026-02-20T02:35:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:35:58 trial106 ceph-mon[44052]: pgmap v360: 129 pgs: 129 active+clean; 187 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 113 op/s 2026-02-20T02:35:59.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 524765 5.89 MB/sec execute 362 sec latency 7.916 ms 2026-02-20T02:35:59.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 75413927 849.64 MB/sec execute 362 sec latency 6.827 ms 2026-02-20T02:36:00.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 526002 5.90 MB/sec execute 363 sec latency 7.598 ms 2026-02-20T02:36:00.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 75576935 849.72 MB/sec execute 363 sec latency 0.256 ms 2026-02-20T02:36:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:00 trial098 ceph-mon[38923]: pgmap v361: 129 pgs: 129 active+clean; 189 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 3.0 MiB/s wr, 138 op/s 2026-02-20T02:36:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:00 trial106 ceph-mon[44052]: pgmap v361: 129 pgs: 129 active+clean; 189 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 3.0 MiB/s wr, 138 op/s 2026-02-20T02:36:01.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 526934 5.90 MB/sec execute 364 sec latency 7.930 ms 2026-02-20T02:36:01.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 75733387 849.75 MB/sec execute 364 sec latency 0.261 ms 2026-02-20T02:36:02.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 528129 5.89 MB/sec execute 365 sec latency 7.520 ms 2026-02-20T02:36:02.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 75887566 849.69 MB/sec execute 365 sec latency 41.473 ms 2026-02-20T02:36:03.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:02 trial098 ceph-mon[38923]: pgmap v362: 129 pgs: 129 active+clean; 190 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 135 op/s 2026-02-20T02:36:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:02 trial106 ceph-mon[44052]: pgmap v362: 129 pgs: 129 active+clean; 190 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 135 op/s 2026-02-20T02:36:03.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 529338 5.91 MB/sec execute 366 sec latency 28.152 ms 2026-02-20T02:36:03.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 76047460 849.72 MB/sec execute 366 sec latency 12.539 ms 2026-02-20T02:36:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:36:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:36:04.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 530233 5.90 MB/sec execute 367 sec latency 7.868 ms 2026-02-20T02:36:04.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 76209584 849.85 MB/sec execute 367 sec latency 0.289 ms 2026-02-20T02:36:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:04 trial098 ceph-mon[38923]: pgmap v363: 129 pgs: 129 active+clean; 189 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 116 op/s 2026-02-20T02:36:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:04 trial106 ceph-mon[44052]: pgmap v363: 129 pgs: 129 active+clean; 189 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 116 op/s 2026-02-20T02:36:05.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 531412 5.89 MB/sec execute 368 sec latency 7.806 ms 2026-02-20T02:36:05.366 INFO:tasks.workunit.client.0.trial098.stdout: 1 76371470 849.90 MB/sec execute 368 sec latency 0.368 ms 2026-02-20T02:36:06.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 532647 5.90 MB/sec execute 369 sec latency 7.851 ms 2026-02-20T02:36:06.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 76532721 849.96 MB/sec execute 369 sec latency 0.296 ms 2026-02-20T02:36:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:06 trial098 ceph-mon[38923]: pgmap v364: 129 pgs: 129 active+clean; 191 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2026-02-20T02:36:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:06 trial106 ceph-mon[44052]: pgmap v364: 129 pgs: 129 active+clean; 191 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 147 op/s 2026-02-20T02:36:07.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 533496 5.90 MB/sec execute 370 sec latency 7.919 ms 2026-02-20T02:36:07.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 76683453 849.90 MB/sec execute 370 sec latency 35.917 ms 2026-02-20T02:36:08.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 534297 5.90 MB/sec execute 371 sec latency 34.353 ms 2026-02-20T02:36:08.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 76714001 848.06 MB/sec execute 371 sec latency 95.641 ms 2026-02-20T02:36:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:08 trial098 ceph-mon[38923]: pgmap v365: 129 pgs: 129 active+clean; 191 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 124 op/s 2026-02-20T02:36:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:08 trial106 ceph-mon[44052]: pgmap v365: 129 pgs: 129 active+clean; 191 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 124 op/s 2026-02-20T02:36:09.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 535378 5.89 MB/sec execute 372 sec latency 26.941 ms 2026-02-20T02:36:09.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 76876724 848.13 MB/sec execute 372 sec latency 0.251 ms 2026-02-20T02:36:10.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 536632 5.90 MB/sec execute 373 sec latency 7.680 ms 2026-02-20T02:36:10.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 77041393 848.29 MB/sec execute 373 sec latency 0.311 ms 2026-02-20T02:36:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:10 trial098 ceph-mon[38923]: pgmap v366: 129 pgs: 129 active+clean; 190 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2026-02-20T02:36:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:10 trial106 ceph-mon[44052]: pgmap v366: 129 pgs: 129 active+clean; 190 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2026-02-20T02:36:11.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 537534 5.89 MB/sec execute 374 sec latency 7.408 ms 2026-02-20T02:36:11.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 77203618 848.36 MB/sec execute 374 sec latency 0.249 ms 2026-02-20T02:36:12.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 538728 5.89 MB/sec execute 375 sec latency 7.756 ms 2026-02-20T02:36:12.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 77368943 848.47 MB/sec execute 375 sec latency 0.253 ms 2026-02-20T02:36:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:12 trial098 ceph-mon[38923]: pgmap v367: 129 pgs: 129 active+clean; 194 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.5 MiB/s wr, 126 op/s 2026-02-20T02:36:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:12 trial106 ceph-mon[44052]: pgmap v367: 129 pgs: 129 active+clean; 194 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.5 MiB/s wr, 126 op/s 2026-02-20T02:36:13.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 539793 5.89 MB/sec execute 376 sec latency 7.635 ms 2026-02-20T02:36:13.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 77529958 848.56 MB/sec execute 376 sec latency 4.957 ms 2026-02-20T02:36:14.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 540647 5.89 MB/sec execute 377 sec latency 29.591 ms 2026-02-20T02:36:14.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 77662230 848.21 MB/sec execute 377 sec latency 56.890 ms 2026-02-20T02:36:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:14 trial098 ceph-mon[38923]: pgmap v368: 129 pgs: 129 active+clean; 194 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 130 op/s 2026-02-20T02:36:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:14 trial106 ceph-mon[44052]: pgmap v368: 129 pgs: 129 active+clean; 194 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 130 op/s 2026-02-20T02:36:15.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 541791 5.89 MB/sec execute 378 sec latency 7.491 ms 2026-02-20T02:36:15.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 77824283 848.27 MB/sec execute 378 sec latency 0.631 ms 2026-02-20T02:36:16.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 543152 5.89 MB/sec execute 379 sec latency 7.524 ms 2026-02-20T02:36:16.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 77985687 848.38 MB/sec execute 379 sec latency 0.265 ms 2026-02-20T02:36:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:16 trial098 ceph-mon[38923]: pgmap v369: 129 pgs: 129 active+clean; 193 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:36:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:16 trial106 ceph-mon[44052]: pgmap v369: 129 pgs: 129 active+clean; 193 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:36:17.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 544000 5.89 MB/sec execute 380 sec latency 8.176 ms 2026-02-20T02:36:17.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 78148865 848.46 MB/sec execute 380 sec latency 0.287 ms 2026-02-20T02:36:18.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 545053 5.89 MB/sec execute 381 sec latency 7.901 ms 2026-02-20T02:36:18.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 78313716 848.57 MB/sec execute 381 sec latency 0.242 ms 2026-02-20T02:36:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:18 trial098 ceph-mon[38923]: pgmap v370: 129 pgs: 129 active+clean; 195 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 119 op/s 2026-02-20T02:36:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:36:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:18 trial106 ceph-mon[44052]: pgmap v370: 129 pgs: 129 active+clean; 195 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 119 op/s 2026-02-20T02:36:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:36:19.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 546120 5.88 MB/sec execute 382 sec latency 25.767 ms 2026-02-20T02:36:19.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 78439628 848.16 MB/sec execute 382 sec latency 49.908 ms 2026-02-20T02:36:20.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 547317 5.90 MB/sec execute 383 sec latency 33.135 ms 2026-02-20T02:36:20.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 78604385 848.27 MB/sec execute 383 sec latency 0.614 ms 2026-02-20T02:36:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:20 trial098 ceph-mon[38923]: pgmap v371: 129 pgs: 129 active+clean; 196 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 121 op/s 2026-02-20T02:36:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:20 trial106 ceph-mon[44052]: pgmap v371: 129 pgs: 129 active+clean; 196 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 121 op/s 2026-02-20T02:36:21.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 548174 5.89 MB/sec execute 384 sec latency 8.408 ms 2026-02-20T02:36:21.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 78767465 848.35 MB/sec execute 384 sec latency 0.245 ms 2026-02-20T02:36:22.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 549248 5.88 MB/sec execute 385 sec latency 8.197 ms 2026-02-20T02:36:22.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 78927256 848.43 MB/sec execute 385 sec latency 12.445 ms 2026-02-20T02:36:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:22 trial098 ceph-mon[38923]: pgmap v372: 129 pgs: 129 active+clean; 199 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 142 op/s 2026-02-20T02:36:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:22 trial106 ceph-mon[44052]: pgmap v372: 129 pgs: 129 active+clean; 199 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 142 op/s 2026-02-20T02:36:23.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 550393 5.89 MB/sec execute 386 sec latency 7.948 ms 2026-02-20T02:36:23.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 79090536 848.52 MB/sec execute 386 sec latency 0.638 ms 2026-02-20T02:36:24.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 551275 5.89 MB/sec execute 387 sec latency 9.416 ms 2026-02-20T02:36:24.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 79258838 848.66 MB/sec execute 387 sec latency 0.256 ms 2026-02-20T02:36:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:24 trial098 ceph-mon[38923]: pgmap v373: 129 pgs: 129 active+clean; 200 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 116 op/s 2026-02-20T02:36:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:24 trial106 ceph-mon[44052]: pgmap v373: 129 pgs: 129 active+clean; 200 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 116 op/s 2026-02-20T02:36:25.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 552262 5.88 MB/sec execute 388 sec latency 35.330 ms 2026-02-20T02:36:25.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 79390307 848.34 MB/sec execute 388 sec latency 44.497 ms 2026-02-20T02:36:26.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 553392 5.88 MB/sec execute 389 sec latency 37.199 ms 2026-02-20T02:36:26.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 79553471 848.43 MB/sec execute 389 sec latency 0.290 ms 2026-02-20T02:36:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: pgmap v374: 129 pgs: 129 active+clean; 200 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2026-02-20T02:36:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:36:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:36:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:36:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:36:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:36:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:36:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:36:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:36:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:36:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:36:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: pgmap v374: 129 pgs: 129 active+clean; 200 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:36:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:36:27.126 INFO:tasks.workunit.client.1.trial106.stdout: 1 554486 5.89 MB/sec execute 390 sec latency 7.560 ms 2026-02-20T02:36:27.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 79716418 848.50 MB/sec execute 390 sec latency 2.217 ms 2026-02-20T02:36:28.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:27 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial098 to 17651M 2026-02-20T02:36:28.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:27 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial098 to 17651M 2026-02-20T02:36:28.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 555367 5.88 MB/sec execute 391 sec latency 9.236 ms 2026-02-20T02:36:28.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 79879294 848.62 MB/sec execute 391 sec latency 6.081 ms 2026-02-20T02:36:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:28 trial098 ceph-mon[38923]: pgmap v375: 129 pgs: 129 active+clean; 200 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:36:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:28 trial106 ceph-mon[44052]: pgmap v375: 129 pgs: 129 active+clean; 200 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:36:29.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 556538 5.88 MB/sec execute 392 sec latency 7.877 ms 2026-02-20T02:36:29.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 80043302 848.72 MB/sec execute 392 sec latency 0.268 ms 2026-02-20T02:36:30.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 557824 5.89 MB/sec execute 393 sec latency 7.651 ms 2026-02-20T02:36:30.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 80205270 848.78 MB/sec execute 393 sec latency 16.942 ms 2026-02-20T02:36:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:30 trial106 ceph-mon[44052]: pgmap v376: 129 pgs: 129 active+clean; 199 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 2.8 MiB/s wr, 113 op/s 2026-02-20T02:36:31.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 558589 5.88 MB/sec execute 394 sec latency 32.590 ms 2026-02-20T02:36:31.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:30 trial098 ceph-mon[38923]: pgmap v376: 129 pgs: 129 active+clean; 199 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 2.8 MiB/s wr, 113 op/s 2026-02-20T02:36:31.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 80338319 848.49 MB/sec execute 394 sec latency 50.602 ms 2026-02-20T02:36:32.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 559743 5.88 MB/sec execute 395 sec latency 7.414 ms 2026-02-20T02:36:32.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 80501398 848.57 MB/sec execute 395 sec latency 0.271 ms 2026-02-20T02:36:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:32 trial106 ceph-mon[44052]: pgmap v377: 129 pgs: 129 active+clean; 202 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.5 MiB/s wr, 133 op/s 2026-02-20T02:36:33.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 561004 5.88 MB/sec execute 396 sec latency 7.818 ms 2026-02-20T02:36:33.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:32 trial098 ceph-mon[38923]: pgmap v377: 129 pgs: 129 active+clean; 202 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.5 MiB/s wr, 133 op/s 2026-02-20T02:36:33.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 80663456 848.63 MB/sec execute 396 sec latency 0.632 ms 2026-02-20T02:36:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:36:34.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 561841 5.88 MB/sec execute 397 sec latency 7.713 ms 2026-02-20T02:36:34.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:36:34.367 INFO:tasks.workunit.client.0.trial098.stdout: 1 80823252 848.70 MB/sec execute 397 sec latency 5.610 ms 2026-02-20T02:36:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:34 trial106 ceph-mon[44052]: pgmap v378: 129 pgs: 129 active+clean; 201 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.5 MiB/s wr, 115 op/s 2026-02-20T02:36:35.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 562967 5.88 MB/sec execute 398 sec latency 7.592 ms 2026-02-20T02:36:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:34 trial098 ceph-mon[38923]: pgmap v378: 129 pgs: 129 active+clean; 201 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.5 MiB/s wr, 115 op/s 2026-02-20T02:36:35.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 80988389 848.81 MB/sec execute 398 sec latency 0.640 ms 2026-02-20T02:36:36.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 564131 5.88 MB/sec execute 399 sec latency 32.281 ms 2026-02-20T02:36:36.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 81123015 848.50 MB/sec execute 399 sec latency 68.297 ms 2026-02-20T02:36:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:36 trial106 ceph-mon[44052]: pgmap v379: 129 pgs: 129 active+clean; 203 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.4 MiB/s wr, 135 op/s 2026-02-20T02:36:37.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 565176 5.89 MB/sec execute 400 sec latency 22.514 ms 2026-02-20T02:36:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:36 trial098 ceph-mon[38923]: pgmap v379: 129 pgs: 129 active+clean; 203 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.4 MiB/s wr, 135 op/s 2026-02-20T02:36:37.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 81286269 848.62 MB/sec execute 400 sec latency 0.258 ms 2026-02-20T02:36:38.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 566211 5.88 MB/sec execute 401 sec latency 8.293 ms 2026-02-20T02:36:38.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 81450339 848.71 MB/sec execute 401 sec latency 0.296 ms 2026-02-20T02:36:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:38 trial106 ceph-mon[44052]: pgmap v380: 129 pgs: 129 active+clean; 201 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.2 MiB/s wr, 112 op/s 2026-02-20T02:36:39.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 567295 5.88 MB/sec execute 402 sec latency 7.988 ms 2026-02-20T02:36:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:38 trial098 ceph-mon[38923]: pgmap v380: 129 pgs: 129 active+clean; 201 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.2 MiB/s wr, 112 op/s 2026-02-20T02:36:39.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 81610479 848.79 MB/sec execute 402 sec latency 0.266 ms 2026-02-20T02:36:40.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 568617 5.89 MB/sec execute 403 sec latency 8.654 ms 2026-02-20T02:36:40.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 81772465 848.85 MB/sec execute 403 sec latency 0.250 ms 2026-02-20T02:36:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:40 trial106 ceph-mon[44052]: pgmap v381: 129 pgs: 129 active+clean; 203 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 2.7 MiB/s wr, 113 op/s 2026-02-20T02:36:41.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 569527 5.88 MB/sec execute 404 sec latency 7.544 ms 2026-02-20T02:36:41.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:40 trial098 ceph-mon[38923]: pgmap v381: 129 pgs: 129 active+clean; 203 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 2.7 MiB/s wr, 113 op/s 2026-02-20T02:36:41.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 81934737 848.91 MB/sec execute 404 sec latency 3.310 ms 2026-02-20T02:36:42.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 570652 5.88 MB/sec execute 405 sec latency 7.122 ms 2026-02-20T02:36:42.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 82094952 848.99 MB/sec execute 405 sec latency 0.279 ms 2026-02-20T02:36:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:42 trial106 ceph-mon[44052]: pgmap v382: 129 pgs: 129 active+clean; 205 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 138 op/s 2026-02-20T02:36:43.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 571733 5.88 MB/sec execute 406 sec latency 8.227 ms 2026-02-20T02:36:43.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:42 trial098 ceph-mon[38923]: pgmap v382: 129 pgs: 129 active+clean; 205 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 138 op/s 2026-02-20T02:36:43.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 82257071 849.05 MB/sec execute 406 sec latency 8.366 ms 2026-02-20T02:36:44.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 572711 5.88 MB/sec execute 407 sec latency 7.681 ms 2026-02-20T02:36:44.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 82422599 849.16 MB/sec execute 407 sec latency 3.065 ms 2026-02-20T02:36:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:44 trial106 ceph-mon[44052]: pgmap v383: 129 pgs: 129 active+clean; 206 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 115 op/s 2026-02-20T02:36:45.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 573811 5.88 MB/sec execute 408 sec latency 7.491 ms 2026-02-20T02:36:45.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:44 trial098 ceph-mon[38923]: pgmap v383: 129 pgs: 129 active+clean; 206 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 115 op/s 2026-02-20T02:36:45.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 82586315 849.28 MB/sec execute 408 sec latency 0.380 ms 2026-02-20T02:36:46.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 575177 5.88 MB/sec execute 409 sec latency 6.672 ms 2026-02-20T02:36:46.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 82749474 849.36 MB/sec execute 409 sec latency 0.268 ms 2026-02-20T02:36:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:46 trial106 ceph-mon[44052]: pgmap v384: 129 pgs: 129 active+clean; 207 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.8 MiB/s wr, 142 op/s 2026-02-20T02:36:47.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 576022 5.88 MB/sec execute 410 sec latency 7.011 ms 2026-02-20T02:36:47.161 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:46 trial098 ceph-mon[38923]: pgmap v384: 129 pgs: 129 active+clean; 207 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.8 MiB/s wr, 142 op/s 2026-02-20T02:36:47.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 82910603 849.40 MB/sec execute 410 sec latency 0.235 ms 2026-02-20T02:36:48.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 577084 5.88 MB/sec execute 411 sec latency 7.326 ms 2026-02-20T02:36:48.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 83072080 849.50 MB/sec execute 411 sec latency 0.252 ms 2026-02-20T02:36:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:48 trial106 ceph-mon[44052]: pgmap v385: 129 pgs: 129 active+clean; 207 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 118 op/s 2026-02-20T02:36:49.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:36:49.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 578309 5.88 MB/sec execute 412 sec latency 8.024 ms 2026-02-20T02:36:49.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:48 trial098 ceph-mon[38923]: pgmap v385: 129 pgs: 129 active+clean; 207 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 118 op/s 2026-02-20T02:36:49.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:36:49.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 83232088 849.52 MB/sec execute 412 sec latency 20.695 ms 2026-02-20T02:36:50.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 579365 5.89 MB/sec execute 413 sec latency 6.587 ms 2026-02-20T02:36:50.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 83397258 849.63 MB/sec execute 413 sec latency 0.252 ms 2026-02-20T02:36:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:50 trial106 ceph-mon[44052]: pgmap v386: 129 pgs: 129 active+clean; 207 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 118 op/s 2026-02-20T02:36:51.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 580412 5.88 MB/sec execute 414 sec latency 8.081 ms 2026-02-20T02:36:51.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:50 trial098 ceph-mon[38923]: pgmap v386: 129 pgs: 129 active+clean; 207 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 118 op/s 2026-02-20T02:36:51.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 83556622 849.69 MB/sec execute 414 sec latency 0.286 ms 2026-02-20T02:36:52.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 581525 5.88 MB/sec execute 415 sec latency 15.379 ms 2026-02-20T02:36:52.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 83714697 849.70 MB/sec execute 415 sec latency 30.575 ms 2026-02-20T02:36:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:52 trial106 ceph-mon[44052]: pgmap v387: 129 pgs: 129 active+clean; 208 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 142 op/s 2026-02-20T02:36:53.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 582778 5.89 MB/sec execute 416 sec latency 9.543 ms 2026-02-20T02:36:53.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:52 trial098 ceph-mon[38923]: pgmap v387: 129 pgs: 129 active+clean; 208 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 142 op/s 2026-02-20T02:36:53.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 83877013 849.76 MB/sec execute 416 sec latency 0.327 ms 2026-02-20T02:36:54.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 583670 5.88 MB/sec execute 417 sec latency 7.834 ms 2026-02-20T02:36:54.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 84037324 849.84 MB/sec execute 417 sec latency 0.260 ms 2026-02-20T02:36:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:54 trial106 ceph-mon[44052]: pgmap v388: 129 pgs: 129 active+clean; 205 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2026-02-20T02:36:55.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 584838 5.88 MB/sec execute 418 sec latency 7.623 ms 2026-02-20T02:36:55.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:54 trial098 ceph-mon[38923]: pgmap v388: 129 pgs: 129 active+clean; 205 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2026-02-20T02:36:55.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 84198010 849.87 MB/sec execute 418 sec latency 0.247 ms 2026-02-20T02:36:56.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 585917 5.88 MB/sec execute 419 sec latency 7.546 ms 2026-02-20T02:36:56.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 84357353 849.94 MB/sec execute 419 sec latency 6.352 ms 2026-02-20T02:36:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:56 trial106 ceph-mon[44052]: pgmap v389: 129 pgs: 129 active+clean; 203 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 147 op/s 2026-02-20T02:36:57.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 586827 5.88 MB/sec execute 420 sec latency 31.012 ms 2026-02-20T02:36:57.277 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:56 trial098 ceph-mon[38923]: pgmap v389: 129 pgs: 129 active+clean; 203 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 147 op/s 2026-02-20T02:36:57.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 84456669 849.19 MB/sec execute 420 sec latency 57.168 ms 2026-02-20T02:36:58.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 587674 5.88 MB/sec execute 421 sec latency 34.129 ms 2026-02-20T02:36:58.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 84564179 848.55 MB/sec execute 421 sec latency 66.792 ms 2026-02-20T02:36:58.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:36:58 trial098 ceph-mon[38923]: pgmap v390: 129 pgs: 129 active+clean; 191 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 116 op/s 2026-02-20T02:36:58.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:36:58 trial106 ceph-mon[44052]: pgmap v390: 129 pgs: 129 active+clean; 191 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 116 op/s 2026-02-20T02:36:59.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 588942 5.88 MB/sec execute 422 sec latency 7.445 ms 2026-02-20T02:36:59.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 84728400 848.63 MB/sec execute 422 sec latency 5.003 ms 2026-02-20T02:37:00.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 589945 5.88 MB/sec execute 423 sec latency 7.646 ms 2026-02-20T02:37:00.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 84891365 848.74 MB/sec execute 423 sec latency 0.294 ms 2026-02-20T02:37:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:00 trial098 ceph-mon[38923]: pgmap v391: 129 pgs: 129 active+clean; 191 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 120 op/s 2026-02-20T02:37:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:00 trial106 ceph-mon[44052]: pgmap v391: 129 pgs: 129 active+clean; 191 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 120 op/s 2026-02-20T02:37:01.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 590877 5.87 MB/sec execute 424 sec latency 7.972 ms 2026-02-20T02:37:01.368 INFO:tasks.workunit.client.0.trial098.stdout: 1 85053818 848.81 MB/sec execute 424 sec latency 0.240 ms 2026-02-20T02:37:02.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 592063 5.87 MB/sec execute 425 sec latency 7.831 ms 2026-02-20T02:37:02.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 85212786 848.83 MB/sec execute 425 sec latency 0.833 ms 2026-02-20T02:37:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:02 trial098 ceph-mon[38923]: pgmap v392: 129 pgs: 129 active+clean; 192 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.5 MiB/s wr, 141 op/s 2026-02-20T02:37:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:02 trial106 ceph-mon[44052]: pgmap v392: 129 pgs: 129 active+clean; 192 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.5 MiB/s wr, 141 op/s 2026-02-20T02:37:03.127 INFO:tasks.workunit.client.1.trial106.stdout: 1 593309 5.88 MB/sec execute 426 sec latency 8.765 ms 2026-02-20T02:37:03.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 85373481 848.91 MB/sec execute 426 sec latency 0.257 ms 2026-02-20T02:37:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:37:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:37:04.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 594201 5.88 MB/sec execute 427 sec latency 8.314 ms 2026-02-20T02:37:04.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 85537406 848.99 MB/sec execute 427 sec latency 0.589 ms 2026-02-20T02:37:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:04 trial098 ceph-mon[38923]: pgmap v393: 129 pgs: 129 active+clean; 192 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 119 op/s 2026-02-20T02:37:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:04 trial106 ceph-mon[44052]: pgmap v393: 129 pgs: 129 active+clean; 192 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 119 op/s 2026-02-20T02:37:05.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 595303 5.87 MB/sec execute 428 sec latency 7.614 ms 2026-02-20T02:37:05.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 85703880 849.11 MB/sec execute 428 sec latency 0.355 ms 2026-02-20T02:37:06.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 596479 5.88 MB/sec execute 429 sec latency 6.972 ms 2026-02-20T02:37:06.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 85867221 849.22 MB/sec execute 429 sec latency 5.038 ms 2026-02-20T02:37:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:06 trial098 ceph-mon[38923]: pgmap v394: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2026-02-20T02:37:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:06 trial106 ceph-mon[44052]: pgmap v394: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 135 op/s 2026-02-20T02:37:07.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 597300 5.88 MB/sec execute 430 sec latency 8.138 ms 2026-02-20T02:37:07.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 86031468 849.30 MB/sec execute 430 sec latency 0.269 ms 2026-02-20T02:37:08.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 598403 5.87 MB/sec execute 431 sec latency 8.769 ms 2026-02-20T02:37:08.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 86172910 849.14 MB/sec execute 431 sec latency 64.344 ms 2026-02-20T02:37:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:08 trial098 ceph-mon[38923]: pgmap v395: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 109 op/s 2026-02-20T02:37:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:08 trial106 ceph-mon[44052]: pgmap v395: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 109 op/s 2026-02-20T02:37:09.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 599294 5.87 MB/sec execute 432 sec latency 39.773 ms 2026-02-20T02:37:09.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 86289640 848.64 MB/sec execute 432 sec latency 85.811 ms 2026-02-20T02:37:10.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 600512 5.88 MB/sec execute 433 sec latency 7.859 ms 2026-02-20T02:37:10.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 86453194 848.71 MB/sec execute 433 sec latency 10.763 ms 2026-02-20T02:37:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:10 trial098 ceph-mon[38923]: pgmap v396: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T02:37:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:10 trial106 ceph-mon[44052]: pgmap v396: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T02:37:11.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 601435 5.87 MB/sec execute 434 sec latency 7.727 ms 2026-02-20T02:37:11.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 86616297 848.78 MB/sec execute 434 sec latency 0.231 ms 2026-02-20T02:37:12.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 602620 5.87 MB/sec execute 435 sec latency 7.451 ms 2026-02-20T02:37:12.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 86778887 848.88 MB/sec execute 435 sec latency 0.292 ms 2026-02-20T02:37:12.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:12 trial098 ceph-mon[38923]: pgmap v397: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 131 op/s 2026-02-20T02:37:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:12 trial106 ceph-mon[44052]: pgmap v397: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 131 op/s 2026-02-20T02:37:13.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 603781 5.88 MB/sec execute 436 sec latency 8.209 ms 2026-02-20T02:37:13.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 86943034 848.97 MB/sec execute 436 sec latency 4.893 ms 2026-02-20T02:37:14.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 604561 5.87 MB/sec execute 437 sec latency 37.180 ms 2026-02-20T02:37:14.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 87077268 848.68 MB/sec execute 437 sec latency 51.009 ms 2026-02-20T02:37:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:14 trial098 ceph-mon[38923]: pgmap v398: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2026-02-20T02:37:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:14 trial106 ceph-mon[44052]: pgmap v398: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2026-02-20T02:37:15.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 605722 5.87 MB/sec execute 438 sec latency 7.658 ms 2026-02-20T02:37:15.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 87239201 848.77 MB/sec execute 438 sec latency 4.565 ms 2026-02-20T02:37:16.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 607106 5.87 MB/sec execute 439 sec latency 7.037 ms 2026-02-20T02:37:16.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 87403411 848.85 MB/sec execute 439 sec latency 0.311 ms 2026-02-20T02:37:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:16 trial098 ceph-mon[38923]: pgmap v399: 129 pgs: 129 active+clean; 199 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.5 MiB/s wr, 134 op/s 2026-02-20T02:37:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:16 trial106 ceph-mon[44052]: pgmap v399: 129 pgs: 129 active+clean; 199 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.5 MiB/s wr, 134 op/s 2026-02-20T02:37:17.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 607933 5.87 MB/sec execute 440 sec latency 9.959 ms 2026-02-20T02:37:17.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 87565561 848.95 MB/sec execute 440 sec latency 0.289 ms 2026-02-20T02:37:18.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 609039 5.87 MB/sec execute 441 sec latency 8.286 ms 2026-02-20T02:37:18.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 87726869 848.99 MB/sec execute 441 sec latency 0.267 ms 2026-02-20T02:37:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:18 trial098 ceph-mon[38923]: pgmap v400: 129 pgs: 129 active+clean; 201 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 132 op/s 2026-02-20T02:37:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:37:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:18 trial106 ceph-mon[44052]: pgmap v400: 129 pgs: 129 active+clean; 201 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 132 op/s 2026-02-20T02:37:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:37:19.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 610310 5.87 MB/sec execute 442 sec latency 7.742 ms 2026-02-20T02:37:19.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 87891991 849.09 MB/sec execute 442 sec latency 0.547 ms 2026-02-20T02:37:20.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 611205 5.87 MB/sec execute 443 sec latency 46.066 ms 2026-02-20T02:37:20.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 88016021 848.72 MB/sec execute 443 sec latency 77.306 ms 2026-02-20T02:37:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:20 trial098 ceph-mon[38923]: pgmap v401: 129 pgs: 129 active+clean; 199 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T02:37:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:20 trial106 ceph-mon[44052]: pgmap v401: 129 pgs: 129 active+clean; 199 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T02:37:21.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 612132 5.87 MB/sec execute 444 sec latency 8.315 ms 2026-02-20T02:37:21.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 88179413 848.80 MB/sec execute 444 sec latency 0.247 ms 2026-02-20T02:37:22.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 613305 5.86 MB/sec execute 445 sec latency 8.383 ms 2026-02-20T02:37:22.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 88339238 848.83 MB/sec execute 445 sec latency 5.978 ms 2026-02-20T02:37:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:22 trial098 ceph-mon[38923]: pgmap v402: 129 pgs: 129 active+clean; 199 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 112 op/s 2026-02-20T02:37:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:22 trial106 ceph-mon[44052]: pgmap v402: 129 pgs: 129 active+clean; 199 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 112 op/s 2026-02-20T02:37:23.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 614552 5.88 MB/sec execute 446 sec latency 10.280 ms 2026-02-20T02:37:23.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 88498061 848.87 MB/sec execute 446 sec latency 0.254 ms 2026-02-20T02:37:24.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 615413 5.87 MB/sec execute 447 sec latency 7.653 ms 2026-02-20T02:37:24.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 88658697 848.92 MB/sec execute 447 sec latency 2.000 ms 2026-02-20T02:37:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:24 trial098 ceph-mon[38923]: pgmap v403: 129 pgs: 129 active+clean; 201 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 138 op/s 2026-02-20T02:37:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:24 trial106 ceph-mon[44052]: pgmap v403: 129 pgs: 129 active+clean; 201 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 138 op/s 2026-02-20T02:37:25.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 616581 5.87 MB/sec execute 448 sec latency 7.168 ms 2026-02-20T02:37:25.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 88790549 848.61 MB/sec execute 448 sec latency 52.034 ms 2026-02-20T02:37:26.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 617745 5.87 MB/sec execute 449 sec latency 28.137 ms 2026-02-20T02:37:26.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 88953042 848.70 MB/sec execute 449 sec latency 0.251 ms 2026-02-20T02:37:26.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:26 trial106 ceph-mon[44052]: pgmap v404: 129 pgs: 129 active+clean; 202 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.8 MiB/s wr, 145 op/s 2026-02-20T02:37:26.867 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:26 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:37:26.887 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:26 trial098 ceph-mon[38923]: pgmap v404: 129 pgs: 129 active+clean; 202 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.8 MiB/s wr, 145 op/s 2026-02-20T02:37:26.887 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:26 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:37:27.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 618573 5.87 MB/sec execute 450 sec latency 6.966 ms 2026-02-20T02:37:27.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 89107731 848.67 MB/sec execute 450 sec latency 1.020 ms 2026-02-20T02:37:28.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 619642 5.87 MB/sec execute 451 sec latency 7.836 ms 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: Adjusting osd_memory_target on trial106 to 18419M 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:37:28.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:37:28.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:28 trial098 ceph-mon[38923]: pgmap v405: 129 pgs: 129 active+clean; 202 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: Adjusting osd_memory_target on trial106 to 18419M 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:37:28.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:28 trial106 ceph-mon[44052]: pgmap v405: 129 pgs: 129 active+clean; 202 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-20T02:37:28.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 89273234 848.77 MB/sec execute 451 sec latency 0.274 ms 2026-02-20T02:37:29.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 620921 5.87 MB/sec execute 452 sec latency 6.862 ms 2026-02-20T02:37:29.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 89440730 848.93 MB/sec execute 452 sec latency 0.267 ms 2026-02-20T02:37:30.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 621885 5.87 MB/sec execute 453 sec latency 8.129 ms 2026-02-20T02:37:30.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 89609212 849.06 MB/sec execute 453 sec latency 2.237 ms 2026-02-20T02:37:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:30 trial098 ceph-mon[38923]: pgmap v406: 129 pgs: 129 active+clean; 202 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 106 op/s 2026-02-20T02:37:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:30 trial106 ceph-mon[44052]: pgmap v406: 129 pgs: 129 active+clean; 202 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.7 MiB/s wr, 106 op/s 2026-02-20T02:37:31.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 622712 5.86 MB/sec execute 454 sec latency 29.872 ms 2026-02-20T02:37:31.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 89743575 848.78 MB/sec execute 454 sec latency 40.547 ms 2026-02-20T02:37:32.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 623926 5.86 MB/sec execute 455 sec latency 6.638 ms 2026-02-20T02:37:32.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 89910084 848.93 MB/sec execute 455 sec latency 0.279 ms 2026-02-20T02:37:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:32 trial098 ceph-mon[38923]: pgmap v407: 129 pgs: 129 active+clean; 204 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 129 op/s 2026-02-20T02:37:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:32 trial106 ceph-mon[44052]: pgmap v407: 129 pgs: 129 active+clean; 204 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 129 op/s 2026-02-20T02:37:33.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 625188 5.87 MB/sec execute 456 sec latency 7.363 ms 2026-02-20T02:37:33.369 INFO:tasks.workunit.client.0.trial098.stdout: 1 90075369 849.02 MB/sec execute 456 sec latency 0.252 ms 2026-02-20T02:37:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:37:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:37:34.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 626017 5.86 MB/sec execute 457 sec latency 8.200 ms 2026-02-20T02:37:34.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 90240651 849.11 MB/sec execute 457 sec latency 8.492 ms 2026-02-20T02:37:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:34 trial098 ceph-mon[38923]: pgmap v408: 129 pgs: 129 active+clean; 203 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 130 op/s 2026-02-20T02:37:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:34 trial106 ceph-mon[44052]: pgmap v408: 129 pgs: 129 active+clean; 203 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 130 op/s 2026-02-20T02:37:35.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 627160 5.86 MB/sec execute 458 sec latency 7.870 ms 2026-02-20T02:37:35.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 90402986 849.21 MB/sec execute 458 sec latency 1.777 ms 2026-02-20T02:37:36.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 628384 5.87 MB/sec execute 459 sec latency 8.616 ms 2026-02-20T02:37:36.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 90567214 849.29 MB/sec execute 459 sec latency 0.969 ms 2026-02-20T02:37:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:36 trial098 ceph-mon[38923]: pgmap v409: 129 pgs: 129 active+clean; 205 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-20T02:37:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:36 trial106 ceph-mon[44052]: pgmap v409: 129 pgs: 129 active+clean; 205 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-20T02:37:37.128 INFO:tasks.workunit.client.1.trial106.stdout: 1 629093 5.87 MB/sec execute 460 sec latency 37.867 ms 2026-02-20T02:37:37.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 90686966 848.84 MB/sec execute 460 sec latency 82.055 ms 2026-02-20T02:37:38.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 630148 5.86 MB/sec execute 461 sec latency 8.071 ms 2026-02-20T02:37:38.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 90849366 848.94 MB/sec execute 461 sec latency 0.293 ms 2026-02-20T02:37:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:38 trial098 ceph-mon[38923]: pgmap v410: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 114 op/s 2026-02-20T02:37:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:38 trial106 ceph-mon[44052]: pgmap v410: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 114 op/s 2026-02-20T02:37:39.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 631217 5.86 MB/sec execute 462 sec latency 6.954 ms 2026-02-20T02:37:39.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 91013559 849.01 MB/sec execute 462 sec latency 0.275 ms 2026-02-20T02:37:40.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 632463 5.87 MB/sec execute 463 sec latency 7.054 ms 2026-02-20T02:37:40.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 91178670 849.10 MB/sec execute 463 sec latency 0.276 ms 2026-02-20T02:37:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:40 trial098 ceph-mon[38923]: pgmap v411: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:37:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:40 trial106 ceph-mon[44052]: pgmap v411: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:37:41.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 633365 5.86 MB/sec execute 464 sec latency 8.602 ms 2026-02-20T02:37:41.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 91339714 849.18 MB/sec execute 464 sec latency 3.718 ms 2026-02-20T02:37:42.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 634502 5.86 MB/sec execute 465 sec latency 28.777 ms 2026-02-20T02:37:42.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 91476277 848.94 MB/sec execute 465 sec latency 62.529 ms 2026-02-20T02:37:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:42 trial098 ceph-mon[38923]: pgmap v412: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 130 op/s 2026-02-20T02:37:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:42 trial106 ceph-mon[44052]: pgmap v412: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 130 op/s 2026-02-20T02:37:43.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 635653 5.87 MB/sec execute 466 sec latency 37.847 ms 2026-02-20T02:37:43.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 91639128 849.00 MB/sec execute 466 sec latency 0.631 ms 2026-02-20T02:37:44.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 636536 5.86 MB/sec execute 467 sec latency 7.469 ms 2026-02-20T02:37:44.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 91804176 849.13 MB/sec execute 467 sec latency 0.269 ms 2026-02-20T02:37:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:44 trial098 ceph-mon[38923]: pgmap v413: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 108 op/s 2026-02-20T02:37:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:44 trial106 ceph-mon[44052]: pgmap v413: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 108 op/s 2026-02-20T02:37:45.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 637670 5.86 MB/sec execute 468 sec latency 7.521 ms 2026-02-20T02:37:45.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 91967281 849.19 MB/sec execute 468 sec latency 0.672 ms 2026-02-20T02:37:46.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 639014 5.87 MB/sec execute 469 sec latency 6.800 ms 2026-02-20T02:37:46.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 92127557 849.25 MB/sec execute 469 sec latency 6.373 ms 2026-02-20T02:37:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:46 trial098 ceph-mon[38923]: pgmap v414: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:37:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:46 trial106 ceph-mon[44052]: pgmap v414: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:37:47.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 639870 5.86 MB/sec execute 470 sec latency 6.935 ms 2026-02-20T02:37:47.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 92291559 849.33 MB/sec execute 470 sec latency 0.269 ms 2026-02-20T02:37:48.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 640881 5.86 MB/sec execute 471 sec latency 31.279 ms 2026-02-20T02:37:48.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 92418632 848.99 MB/sec execute 471 sec latency 52.891 ms 2026-02-20T02:37:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:48 trial098 ceph-mon[38923]: pgmap v415: 129 pgs: 129 active+clean; 211 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 123 op/s 2026-02-20T02:37:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:37:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:48 trial106 ceph-mon[44052]: pgmap v415: 129 pgs: 129 active+clean; 211 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 123 op/s 2026-02-20T02:37:49.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:37:49.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 642129 5.86 MB/sec execute 472 sec latency 7.573 ms 2026-02-20T02:37:49.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 92578037 849.01 MB/sec execute 472 sec latency 0.445 ms 2026-02-20T02:37:50.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 643144 5.87 MB/sec execute 473 sec latency 9.162 ms 2026-02-20T02:37:50.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 92732818 849.01 MB/sec execute 473 sec latency 11.948 ms 2026-02-20T02:37:51.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:50 trial098 ceph-mon[38923]: pgmap v416: 129 pgs: 129 active+clean; 212 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.8 MiB/s wr, 128 op/s 2026-02-20T02:37:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:50 trial106 ceph-mon[44052]: pgmap v416: 129 pgs: 129 active+clean; 212 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.8 MiB/s wr, 128 op/s 2026-02-20T02:37:51.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 644058 5.86 MB/sec execute 474 sec latency 7.771 ms 2026-02-20T02:37:51.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 92896402 849.08 MB/sec execute 474 sec latency 0.249 ms 2026-02-20T02:37:52.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 645232 5.86 MB/sec execute 475 sec latency 6.841 ms 2026-02-20T02:37:52.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 93058951 849.17 MB/sec execute 475 sec latency 0.861 ms 2026-02-20T02:37:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:52 trial098 ceph-mon[38923]: pgmap v417: 129 pgs: 129 active+clean; 209 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:37:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:52 trial106 ceph-mon[44052]: pgmap v417: 129 pgs: 129 active+clean; 209 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:37:53.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 646462 5.87 MB/sec execute 476 sec latency 7.680 ms 2026-02-20T02:37:53.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 93207692 849.08 MB/sec execute 476 sec latency 66.711 ms 2026-02-20T02:37:54.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 647174 5.86 MB/sec execute 477 sec latency 37.690 ms 2026-02-20T02:37:54.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 93339433 848.78 MB/sec execute 477 sec latency 90.614 ms 2026-02-20T02:37:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:54 trial098 ceph-mon[38923]: pgmap v418: 129 pgs: 129 active+clean; 205 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:37:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:54 trial106 ceph-mon[44052]: pgmap v418: 129 pgs: 129 active+clean; 205 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:37:55.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 648225 5.86 MB/sec execute 478 sec latency 8.165 ms 2026-02-20T02:37:55.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 93501928 848.84 MB/sec execute 478 sec latency 0.243 ms 2026-02-20T02:37:56.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 649632 5.86 MB/sec execute 479 sec latency 6.659 ms 2026-02-20T02:37:56.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 93662699 848.91 MB/sec execute 479 sec latency 3.426 ms 2026-02-20T02:37:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:56 trial098 ceph-mon[38923]: pgmap v419: 129 pgs: 129 active+clean; 188 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:37:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:56 trial106 ceph-mon[44052]: pgmap v419: 129 pgs: 129 active+clean; 188 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:37:57.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 650396 5.86 MB/sec execute 480 sec latency 7.950 ms 2026-02-20T02:37:57.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 93825960 848.98 MB/sec execute 480 sec latency 0.483 ms 2026-02-20T02:37:58.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 651488 5.86 MB/sec execute 481 sec latency 7.656 ms 2026-02-20T02:37:58.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 93985197 849.03 MB/sec execute 481 sec latency 0.283 ms 2026-02-20T02:37:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:37:58 trial098 ceph-mon[38923]: pgmap v420: 129 pgs: 129 active+clean; 189 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.4 MiB/s wr, 123 op/s 2026-02-20T02:37:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:37:58 trial106 ceph-mon[44052]: pgmap v420: 129 pgs: 129 active+clean; 189 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.4 MiB/s wr, 123 op/s 2026-02-20T02:37:59.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 652472 5.85 MB/sec execute 482 sec latency 43.413 ms 2026-02-20T02:37:59.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 94109308 848.66 MB/sec execute 482 sec latency 74.966 ms 2026-02-20T02:38:00.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 653696 5.86 MB/sec execute 483 sec latency 6.784 ms 2026-02-20T02:38:00.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 94271900 848.72 MB/sec execute 483 sec latency 0.698 ms 2026-02-20T02:38:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:00 trial098 ceph-mon[38923]: pgmap v421: 129 pgs: 129 active+clean; 191 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:38:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:00 trial106 ceph-mon[44052]: pgmap v421: 129 pgs: 129 active+clean; 191 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:38:01.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 654481 5.86 MB/sec execute 484 sec latency 8.339 ms 2026-02-20T02:38:01.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 94430762 848.77 MB/sec execute 484 sec latency 4.014 ms 2026-02-20T02:38:02.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 655591 5.85 MB/sec execute 485 sec latency 7.327 ms 2026-02-20T02:38:02.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 94593101 848.83 MB/sec execute 485 sec latency 0.662 ms 2026-02-20T02:38:03.045 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:02 trial098 ceph-mon[38923]: pgmap v422: 129 pgs: 129 active+clean; 192 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 128 op/s 2026-02-20T02:38:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:02 trial106 ceph-mon[44052]: pgmap v422: 129 pgs: 129 active+clean; 192 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 128 op/s 2026-02-20T02:38:03.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 656787 5.86 MB/sec execute 486 sec latency 6.770 ms 2026-02-20T02:38:03.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 94751255 848.83 MB/sec execute 486 sec latency 0.239 ms 2026-02-20T02:38:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:38:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:38:04.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 657759 5.86 MB/sec execute 487 sec latency 8.411 ms 2026-02-20T02:38:04.370 INFO:tasks.workunit.client.0.trial098.stdout: 1 94913518 848.92 MB/sec execute 487 sec latency 0.323 ms 2026-02-20T02:38:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:04 trial098 ceph-mon[38923]: pgmap v423: 129 pgs: 129 active+clean; 193 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 105 op/s 2026-02-20T02:38:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:04 trial106 ceph-mon[44052]: pgmap v423: 129 pgs: 129 active+clean; 193 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.7 MiB/s wr, 105 op/s 2026-02-20T02:38:05.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 658861 5.85 MB/sec execute 488 sec latency 7.404 ms 2026-02-20T02:38:05.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 95073060 848.94 MB/sec execute 488 sec latency 7.067 ms 2026-02-20T02:38:06.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 660261 5.86 MB/sec execute 489 sec latency 7.274 ms 2026-02-20T02:38:06.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 95236114 849.00 MB/sec execute 489 sec latency 0.239 ms 2026-02-20T02:38:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:06 trial098 ceph-mon[38923]: pgmap v424: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:38:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:06 trial106 ceph-mon[44052]: pgmap v424: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T02:38:07.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 660999 5.86 MB/sec execute 490 sec latency 7.694 ms 2026-02-20T02:38:07.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 95396977 849.08 MB/sec execute 490 sec latency 0.343 ms 2026-02-20T02:38:08.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 662089 5.86 MB/sec execute 491 sec latency 8.152 ms 2026-02-20T02:38:08.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 95555790 849.09 MB/sec execute 491 sec latency 8.993 ms 2026-02-20T02:38:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:08 trial098 ceph-mon[38923]: pgmap v425: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:38:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:08 trial106 ceph-mon[44052]: pgmap v425: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:38:09.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 663247 5.86 MB/sec execute 492 sec latency 7.490 ms 2026-02-20T02:38:09.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 95713401 849.09 MB/sec execute 492 sec latency 0.659 ms 2026-02-20T02:38:10.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 664354 5.86 MB/sec execute 493 sec latency 7.600 ms 2026-02-20T02:38:10.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 95872315 849.14 MB/sec execute 493 sec latency 0.255 ms 2026-02-20T02:38:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:10 trial098 ceph-mon[38923]: pgmap v426: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:38:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:10 trial106 ceph-mon[44052]: pgmap v426: 129 pgs: 129 active+clean; 195 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-20T02:38:11.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 665250 5.85 MB/sec execute 494 sec latency 7.355 ms 2026-02-20T02:38:11.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 96032184 849.17 MB/sec execute 494 sec latency 6.030 ms 2026-02-20T02:38:12.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 666438 5.85 MB/sec execute 495 sec latency 7.867 ms 2026-02-20T02:38:12.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 96191451 849.19 MB/sec execute 495 sec latency 0.444 ms 2026-02-20T02:38:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:12 trial098 ceph-mon[38923]: pgmap v427: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.3 MiB/s wr, 114 op/s 2026-02-20T02:38:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:12 trial106 ceph-mon[44052]: pgmap v427: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.3 MiB/s wr, 114 op/s 2026-02-20T02:38:13.129 INFO:tasks.workunit.client.1.trial106.stdout: 1 667628 5.86 MB/sec execute 496 sec latency 8.052 ms 2026-02-20T02:38:13.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 96349041 849.22 MB/sec execute 496 sec latency 0.274 ms 2026-02-20T02:38:14.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 668536 5.85 MB/sec execute 497 sec latency 7.389 ms 2026-02-20T02:38:14.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 96511049 849.27 MB/sec execute 497 sec latency 0.248 ms 2026-02-20T02:38:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:14 trial098 ceph-mon[38923]: pgmap v428: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:38:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:14 trial106 ceph-mon[44052]: pgmap v428: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:38:15.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 669678 5.85 MB/sec execute 498 sec latency 10.320 ms 2026-02-20T02:38:15.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 96669385 849.27 MB/sec execute 498 sec latency 22.469 ms 2026-02-20T02:38:16.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 670944 5.86 MB/sec execute 499 sec latency 6.749 ms 2026-02-20T02:38:16.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 96828413 849.33 MB/sec execute 499 sec latency 4.121 ms 2026-02-20T02:38:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:16 trial098 ceph-mon[38923]: pgmap v429: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.5 MiB/s wr, 144 op/s 2026-02-20T02:38:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:16 trial106 ceph-mon[44052]: pgmap v429: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.5 MiB/s wr, 144 op/s 2026-02-20T02:38:17.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 671910 5.86 MB/sec execute 500 sec latency 7.013 ms 2026-02-20T02:38:17.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 96990580 849.38 MB/sec execute 500 sec latency 0.269 ms 2026-02-20T02:38:18.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 673047 5.85 MB/sec execute 501 sec latency 6.927 ms 2026-02-20T02:38:18.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 97150548 849.41 MB/sec execute 501 sec latency 0.291 ms 2026-02-20T02:38:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:18 trial098 ceph-mon[38923]: pgmap v430: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2026-02-20T02:38:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:38:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:18 trial106 ceph-mon[44052]: pgmap v430: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2026-02-20T02:38:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:38:19.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 674487 5.86 MB/sec execute 502 sec latency 7.526 ms 2026-02-20T02:38:19.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 97311723 849.48 MB/sec execute 502 sec latency 0.258 ms 2026-02-20T02:38:20.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 675193 5.86 MB/sec execute 503 sec latency 27.319 ms 2026-02-20T02:38:20.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 97400267 848.74 MB/sec execute 503 sec latency 67.763 ms 2026-02-20T02:38:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:20 trial098 ceph-mon[38923]: pgmap v431: 129 pgs: 129 active+clean; 199 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-20T02:38:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:20 trial106 ceph-mon[44052]: pgmap v431: 129 pgs: 129 active+clean; 199 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-20T02:38:21.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 675977 5.85 MB/sec execute 504 sec latency 34.064 ms 2026-02-20T02:38:21.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 97515488 848.28 MB/sec execute 504 sec latency 63.958 ms 2026-02-20T02:38:22.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 677154 5.85 MB/sec execute 505 sec latency 7.666 ms 2026-02-20T02:38:22.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 97675882 848.35 MB/sec execute 505 sec latency 3.143 ms 2026-02-20T02:38:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:22 trial098 ceph-mon[38923]: pgmap v432: 129 pgs: 129 active+clean; 200 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-20T02:38:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:22 trial106 ceph-mon[44052]: pgmap v432: 129 pgs: 129 active+clean; 200 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-20T02:38:23.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 678393 5.86 MB/sec execute 506 sec latency 9.423 ms 2026-02-20T02:38:23.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 97837727 848.40 MB/sec execute 506 sec latency 8.883 ms 2026-02-20T02:38:24.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 679283 5.85 MB/sec execute 507 sec latency 8.256 ms 2026-02-20T02:38:24.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 98002470 848.48 MB/sec execute 507 sec latency 0.378 ms 2026-02-20T02:38:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:24 trial098 ceph-mon[38923]: pgmap v433: 129 pgs: 129 active+clean; 201 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T02:38:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:24 trial106 ceph-mon[44052]: pgmap v433: 129 pgs: 129 active+clean; 201 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T02:38:25.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 680451 5.85 MB/sec execute 508 sec latency 7.056 ms 2026-02-20T02:38:25.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 98164542 848.56 MB/sec execute 508 sec latency 0.585 ms 2026-02-20T02:38:26.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 681628 5.86 MB/sec execute 509 sec latency 8.015 ms 2026-02-20T02:38:26.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 98323836 848.58 MB/sec execute 509 sec latency 0.433 ms 2026-02-20T02:38:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:26 trial098 ceph-mon[38923]: pgmap v434: 129 pgs: 129 active+clean; 202 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.8 MiB/s wr, 149 op/s 2026-02-20T02:38:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:26 trial106 ceph-mon[44052]: pgmap v434: 129 pgs: 129 active+clean; 202 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.8 MiB/s wr, 149 op/s 2026-02-20T02:38:27.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 682534 5.85 MB/sec execute 510 sec latency 7.014 ms 2026-02-20T02:38:27.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 98482267 848.59 MB/sec execute 510 sec latency 6.808 ms 2026-02-20T02:38:28.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:27 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:38:28.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:27 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:38:28.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 683621 5.85 MB/sec execute 511 sec latency 9.009 ms 2026-02-20T02:38:28.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 98638779 848.61 MB/sec execute 511 sec latency 0.509 ms 2026-02-20T02:38:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:28 trial098 ceph-mon[38923]: pgmap v435: 129 pgs: 129 active+clean; 202 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2026-02-20T02:38:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:38:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:38:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:38:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:28 trial106 ceph-mon[44052]: pgmap v435: 129 pgs: 129 active+clean; 202 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2026-02-20T02:38:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:38:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:38:29.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:38:29.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 684861 5.86 MB/sec execute 512 sec latency 8.004 ms 2026-02-20T02:38:29.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 98799145 848.65 MB/sec execute 512 sec latency 0.257 ms 2026-02-20T02:38:30.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 685826 5.86 MB/sec execute 513 sec latency 7.686 ms 2026-02-20T02:38:30.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 98961980 848.71 MB/sec execute 513 sec latency 0.281 ms 2026-02-20T02:38:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:30 trial098 ceph-mon[38923]: pgmap v436: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-20T02:38:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:30 trial106 ceph-mon[44052]: pgmap v436: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-20T02:38:31.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 686869 5.85 MB/sec execute 514 sec latency 8.288 ms 2026-02-20T02:38:31.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 99118207 848.72 MB/sec execute 514 sec latency 0.291 ms 2026-02-20T02:38:32.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 687959 5.85 MB/sec execute 515 sec latency 7.798 ms 2026-02-20T02:38:32.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 99282644 848.80 MB/sec execute 515 sec latency 0.274 ms 2026-02-20T02:38:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:32 trial098 ceph-mon[38923]: pgmap v437: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 129 op/s 2026-02-20T02:38:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:32 trial106 ceph-mon[44052]: pgmap v437: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 129 op/s 2026-02-20T02:38:33.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 689195 5.86 MB/sec execute 516 sec latency 10.832 ms 2026-02-20T02:38:33.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 99446592 848.87 MB/sec execute 516 sec latency 0.297 ms 2026-02-20T02:38:34.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:38:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:38:34.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 690103 5.85 MB/sec execute 517 sec latency 7.687 ms 2026-02-20T02:38:34.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 99610535 848.97 MB/sec execute 517 sec latency 1.032 ms 2026-02-20T02:38:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:34 trial098 ceph-mon[38923]: pgmap v438: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2026-02-20T02:38:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:34 trial106 ceph-mon[44052]: pgmap v438: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2026-02-20T02:38:35.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 691204 5.85 MB/sec execute 518 sec latency 7.480 ms 2026-02-20T02:38:35.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 99772564 849.02 MB/sec execute 518 sec latency 0.354 ms 2026-02-20T02:38:36.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 692311 5.85 MB/sec execute 519 sec latency 9.380 ms 2026-02-20T02:38:36.371 INFO:tasks.workunit.client.0.trial098.stdout: 1 99935106 849.10 MB/sec execute 519 sec latency 0.280 ms 2026-02-20T02:38:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:36 trial098 ceph-mon[38923]: pgmap v439: 129 pgs: 129 active+clean; 204 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 138 op/s 2026-02-20T02:38:37.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:36 trial106 ceph-mon[44052]: pgmap v439: 129 pgs: 129 active+clean; 204 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 138 op/s 2026-02-20T02:38:37.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 693243 5.85 MB/sec execute 520 sec latency 7.741 ms 2026-02-20T02:38:37.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 100099119 849.17 MB/sec execute 520 sec latency 1.347 ms 2026-02-20T02:38:38.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 694395 5.85 MB/sec execute 521 sec latency 18.990 ms 2026-02-20T02:38:38.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 100261928 849.22 MB/sec execute 521 sec latency 5.091 ms 2026-02-20T02:38:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:38 trial098 ceph-mon[38923]: pgmap v440: 129 pgs: 129 active+clean; 204 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 112 op/s 2026-02-20T02:38:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:38 trial106 ceph-mon[44052]: pgmap v440: 129 pgs: 129 active+clean; 204 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 112 op/s 2026-02-20T02:38:39.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 695770 5.86 MB/sec execute 522 sec latency 6.853 ms 2026-02-20T02:38:39.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 100419686 849.26 MB/sec execute 522 sec latency 0.287 ms 2026-02-20T02:38:40.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 696502 5.85 MB/sec execute 523 sec latency 8.091 ms 2026-02-20T02:38:40.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 100582817 849.32 MB/sec execute 523 sec latency 0.253 ms 2026-02-20T02:38:41.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:40 trial098 ceph-mon[38923]: pgmap v441: 129 pgs: 129 active+clean; 207 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 139 op/s 2026-02-20T02:38:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:40 trial106 ceph-mon[44052]: pgmap v441: 129 pgs: 129 active+clean; 207 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 139 op/s 2026-02-20T02:38:41.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 697601 5.85 MB/sec execute 524 sec latency 8.347 ms 2026-02-20T02:38:41.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 100745262 849.36 MB/sec execute 524 sec latency 0.870 ms 2026-02-20T02:38:42.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 698784 5.85 MB/sec execute 525 sec latency 26.879 ms 2026-02-20T02:38:42.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 100895378 849.32 MB/sec execute 525 sec latency 38.724 ms 2026-02-20T02:38:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:42 trial098 ceph-mon[38923]: pgmap v442: 129 pgs: 129 active+clean; 208 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.3 MiB/s wr, 123 op/s 2026-02-20T02:38:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:42 trial106 ceph-mon[44052]: pgmap v442: 129 pgs: 129 active+clean; 208 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.3 MiB/s wr, 123 op/s 2026-02-20T02:38:43.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 699921 5.86 MB/sec execute 526 sec latency 7.641 ms 2026-02-20T02:38:43.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 101059994 849.39 MB/sec execute 526 sec latency 0.250 ms 2026-02-20T02:38:44.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 700862 5.85 MB/sec execute 527 sec latency 10.050 ms 2026-02-20T02:38:44.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 101220406 849.42 MB/sec execute 527 sec latency 0.800 ms 2026-02-20T02:38:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:44 trial098 ceph-mon[38923]: pgmap v443: 129 pgs: 129 active+clean; 207 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 119 op/s 2026-02-20T02:38:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:44 trial106 ceph-mon[44052]: pgmap v443: 129 pgs: 129 active+clean; 207 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 119 op/s 2026-02-20T02:38:45.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 702025 5.85 MB/sec execute 528 sec latency 7.794 ms 2026-02-20T02:38:45.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 101381547 849.49 MB/sec execute 528 sec latency 0.264 ms 2026-02-20T02:38:46.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 703341 5.86 MB/sec execute 529 sec latency 8.548 ms 2026-02-20T02:38:46.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 101543271 849.53 MB/sec execute 529 sec latency 0.279 ms 2026-02-20T02:38:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:46 trial098 ceph-mon[38923]: pgmap v444: 129 pgs: 129 active+clean; 208 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.8 MiB/s wr, 146 op/s 2026-02-20T02:38:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:46 trial106 ceph-mon[44052]: pgmap v444: 129 pgs: 129 active+clean; 208 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 2.8 MiB/s wr, 146 op/s 2026-02-20T02:38:47.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 703886 5.85 MB/sec execute 530 sec latency 33.223 ms 2026-02-20T02:38:47.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 101571707 848.22 MB/sec execute 530 sec latency 67.972 ms 2026-02-20T02:38:48.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 704822 5.85 MB/sec execute 531 sec latency 37.291 ms 2026-02-20T02:38:48.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 101724367 848.17 MB/sec execute 531 sec latency 49.976 ms 2026-02-20T02:38:48.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:48 trial098 ceph-mon[38923]: pgmap v445: 129 pgs: 129 active+clean; 208 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.3 MiB/s wr, 117 op/s 2026-02-20T02:38:48.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:38:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:48 trial106 ceph-mon[44052]: pgmap v445: 129 pgs: 129 active+clean; 208 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.3 MiB/s wr, 117 op/s 2026-02-20T02:38:49.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:38:49.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 706009 5.85 MB/sec execute 532 sec latency 7.149 ms 2026-02-20T02:38:49.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 101883665 848.23 MB/sec execute 532 sec latency 0.651 ms 2026-02-20T02:38:50.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 707031 5.85 MB/sec execute 533 sec latency 6.864 ms 2026-02-20T02:38:50.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 102042931 848.24 MB/sec execute 533 sec latency 0.236 ms 2026-02-20T02:38:51.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:50 trial098 ceph-mon[38923]: pgmap v446: 129 pgs: 129 active+clean; 198 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-20T02:38:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:50 trial106 ceph-mon[44052]: pgmap v446: 129 pgs: 129 active+clean; 198 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-20T02:38:51.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 707961 5.84 MB/sec execute 534 sec latency 7.692 ms 2026-02-20T02:38:51.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 102206232 848.30 MB/sec execute 534 sec latency 0.358 ms 2026-02-20T02:38:52.130 INFO:tasks.workunit.client.1.trial106.stdout: 1 709126 5.84 MB/sec execute 535 sec latency 6.758 ms 2026-02-20T02:38:52.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 102369190 848.39 MB/sec execute 535 sec latency 3.570 ms 2026-02-20T02:38:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:52 trial098 ceph-mon[38923]: pgmap v447: 129 pgs: 129 active+clean; 195 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.3 MiB/s wr, 121 op/s 2026-02-20T02:38:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:52 trial106 ceph-mon[44052]: pgmap v447: 129 pgs: 129 active+clean; 195 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.3 MiB/s wr, 121 op/s 2026-02-20T02:38:53.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 710297 5.85 MB/sec execute 536 sec latency 36.268 ms 2026-02-20T02:38:53.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 102502320 848.15 MB/sec execute 536 sec latency 62.186 ms 2026-02-20T02:38:54.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 711165 5.85 MB/sec execute 537 sec latency 7.302 ms 2026-02-20T02:38:54.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 102663081 848.18 MB/sec execute 537 sec latency 3.638 ms 2026-02-20T02:38:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:54 trial098 ceph-mon[38923]: pgmap v448: 129 pgs: 129 active+clean; 186 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-20T02:38:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:54 trial106 ceph-mon[44052]: pgmap v448: 129 pgs: 129 active+clean; 186 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-20T02:38:55.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 712364 5.84 MB/sec execute 538 sec latency 7.161 ms 2026-02-20T02:38:55.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 102821387 848.23 MB/sec execute 538 sec latency 0.269 ms 2026-02-20T02:38:56.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 713579 5.85 MB/sec execute 539 sec latency 6.682 ms 2026-02-20T02:38:56.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 102982014 848.26 MB/sec execute 539 sec latency 0.241 ms 2026-02-20T02:38:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:56 trial098 ceph-mon[38923]: pgmap v449: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.7 MiB/s wr, 149 op/s 2026-02-20T02:38:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:56 trial106 ceph-mon[44052]: pgmap v449: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.7 MiB/s wr, 149 op/s 2026-02-20T02:38:57.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 714556 5.85 MB/sec execute 540 sec latency 8.065 ms 2026-02-20T02:38:57.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 103142272 848.32 MB/sec execute 540 sec latency 1.406 ms 2026-02-20T02:38:58.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 715659 5.85 MB/sec execute 541 sec latency 8.868 ms 2026-02-20T02:38:58.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 103297051 848.29 MB/sec execute 541 sec latency 40.442 ms 2026-02-20T02:38:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:38:58 trial098 ceph-mon[38923]: pgmap v450: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 3.9 KiB/s rd, 2.2 MiB/s wr, 117 op/s 2026-02-20T02:38:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:38:58 trial106 ceph-mon[44052]: pgmap v450: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 3.9 KiB/s rd, 2.2 MiB/s wr, 117 op/s 2026-02-20T02:38:59.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 716939 5.85 MB/sec execute 542 sec latency 27.922 ms 2026-02-20T02:38:59.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 103435757 848.11 MB/sec execute 542 sec latency 56.650 ms 2026-02-20T02:39:00.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 717782 5.85 MB/sec execute 543 sec latency 6.762 ms 2026-02-20T02:39:00.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 103593615 848.14 MB/sec execute 543 sec latency 0.254 ms 2026-02-20T02:39:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:00 trial098 ceph-mon[38923]: pgmap v451: 129 pgs: 129 active+clean; 188 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.7 MiB/s wr, 122 op/s 2026-02-20T02:39:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:00 trial106 ceph-mon[44052]: pgmap v451: 129 pgs: 129 active+clean; 188 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 2.7 MiB/s wr, 122 op/s 2026-02-20T02:39:01.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 718889 5.85 MB/sec execute 544 sec latency 9.010 ms 2026-02-20T02:39:01.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 103755446 848.19 MB/sec execute 544 sec latency 0.250 ms 2026-02-20T02:39:02.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 720081 5.85 MB/sec execute 545 sec latency 7.600 ms 2026-02-20T02:39:02.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 103917715 848.23 MB/sec execute 545 sec latency 6.335 ms 2026-02-20T02:39:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:02 trial098 ceph-mon[38923]: pgmap v452: 129 pgs: 129 active+clean; 188 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.3 MiB/s wr, 118 op/s 2026-02-20T02:39:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:02 trial106 ceph-mon[44052]: pgmap v452: 129 pgs: 129 active+clean; 188 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.3 MiB/s wr, 118 op/s 2026-02-20T02:39:03.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 721167 5.85 MB/sec execute 546 sec latency 7.280 ms 2026-02-20T02:39:03.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 104078399 848.30 MB/sec execute 546 sec latency 0.351 ms 2026-02-20T02:39:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:39:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:39:04.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 722099 5.85 MB/sec execute 547 sec latency 7.333 ms 2026-02-20T02:39:04.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 104240111 848.34 MB/sec execute 547 sec latency 0.244 ms 2026-02-20T02:39:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:04 trial098 ceph-mon[38923]: pgmap v453: 129 pgs: 129 active+clean; 190 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 130 op/s 2026-02-20T02:39:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:04 trial106 ceph-mon[44052]: pgmap v453: 129 pgs: 129 active+clean; 190 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 130 op/s 2026-02-20T02:39:05.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 723220 5.84 MB/sec execute 548 sec latency 7.894 ms 2026-02-20T02:39:05.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 104403321 848.40 MB/sec execute 548 sec latency 2.906 ms 2026-02-20T02:39:06.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 724403 5.85 MB/sec execute 549 sec latency 9.760 ms 2026-02-20T02:39:06.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 104563647 848.46 MB/sec execute 549 sec latency 0.669 ms 2026-02-20T02:39:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:06 trial098 ceph-mon[38923]: pgmap v454: 129 pgs: 129 active+clean; 192 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.7 MiB/s wr, 130 op/s 2026-02-20T02:39:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:06 trial106 ceph-mon[44052]: pgmap v454: 129 pgs: 129 active+clean; 192 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 2.7 MiB/s wr, 130 op/s 2026-02-20T02:39:07.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 725272 5.85 MB/sec execute 550 sec latency 7.635 ms 2026-02-20T02:39:07.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 104725266 848.50 MB/sec execute 550 sec latency 0.239 ms 2026-02-20T02:39:08.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 726399 5.84 MB/sec execute 551 sec latency 7.674 ms 2026-02-20T02:39:08.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 104887159 848.55 MB/sec execute 551 sec latency 2.594 ms 2026-02-20T02:39:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:08 trial098 ceph-mon[38923]: pgmap v455: 129 pgs: 129 active+clean; 194 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:39:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:08 trial106 ceph-mon[44052]: pgmap v455: 129 pgs: 129 active+clean; 194 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-20T02:39:09.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 727693 5.85 MB/sec execute 552 sec latency 8.215 ms 2026-02-20T02:39:09.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 105045766 848.59 MB/sec execute 552 sec latency 0.281 ms 2026-02-20T02:39:10.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 728451 5.85 MB/sec execute 553 sec latency 8.956 ms 2026-02-20T02:39:10.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 105207909 848.63 MB/sec execute 553 sec latency 0.252 ms 2026-02-20T02:39:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:10 trial098 ceph-mon[38923]: pgmap v456: 129 pgs: 129 active+clean; 195 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 3.0 MiB/s wr, 130 op/s 2026-02-20T02:39:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:10 trial106 ceph-mon[44052]: pgmap v456: 129 pgs: 129 active+clean; 195 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 3.0 MiB/s wr, 130 op/s 2026-02-20T02:39:11.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 729579 5.85 MB/sec execute 554 sec latency 7.840 ms 2026-02-20T02:39:11.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 105366042 848.64 MB/sec execute 554 sec latency 0.555 ms 2026-02-20T02:39:12.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 730840 5.85 MB/sec execute 555 sec latency 7.222 ms 2026-02-20T02:39:12.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 105524915 848.69 MB/sec execute 555 sec latency 0.555 ms 2026-02-20T02:39:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:12 trial098 ceph-mon[38923]: pgmap v457: 129 pgs: 129 active+clean; 195 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 3.7 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-20T02:39:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:12 trial106 ceph-mon[44052]: pgmap v457: 129 pgs: 129 active+clean; 195 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 3.7 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-20T02:39:13.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 731874 5.85 MB/sec execute 556 sec latency 7.588 ms 2026-02-20T02:39:13.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 105687750 848.74 MB/sec execute 556 sec latency 3.492 ms 2026-02-20T02:39:14.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 732948 5.85 MB/sec execute 557 sec latency 7.305 ms 2026-02-20T02:39:14.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 105841008 848.70 MB/sec execute 557 sec latency 25.787 ms 2026-02-20T02:39:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:14 trial098 ceph-mon[38923]: pgmap v458: 129 pgs: 129 active+clean; 197 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 3.7 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-20T02:39:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:14 trial106 ceph-mon[44052]: pgmap v458: 129 pgs: 129 active+clean; 197 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 3.7 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-20T02:39:15.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 734081 5.84 MB/sec execute 558 sec latency 14.719 ms 2026-02-20T02:39:15.372 INFO:tasks.workunit.client.0.trial098.stdout: 1 105999812 848.74 MB/sec execute 558 sec latency 0.273 ms 2026-02-20T02:39:16.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 735281 5.85 MB/sec execute 559 sec latency 7.745 ms 2026-02-20T02:39:16.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 106161665 848.79 MB/sec execute 559 sec latency 0.612 ms 2026-02-20T02:39:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:16 trial098 ceph-mon[38923]: pgmap v459: 129 pgs: 129 active+clean; 196 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.8 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-20T02:39:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:16 trial106 ceph-mon[44052]: pgmap v459: 129 pgs: 129 active+clean; 196 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.8 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-20T02:39:17.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 736194 5.85 MB/sec execute 560 sec latency 7.294 ms 2026-02-20T02:39:17.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 106318322 848.78 MB/sec execute 560 sec latency 6.969 ms 2026-02-20T02:39:18.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 737397 5.84 MB/sec execute 561 sec latency 7.962 ms 2026-02-20T02:39:18.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 106477514 848.83 MB/sec execute 561 sec latency 0.268 ms 2026-02-20T02:39:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:18 trial098 ceph-mon[38923]: pgmap v460: 129 pgs: 129 active+clean; 195 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2026-02-20T02:39:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:39:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:18 trial106 ceph-mon[44052]: pgmap v460: 129 pgs: 129 active+clean; 195 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.4 MiB/s wr, 118 op/s 2026-02-20T02:39:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:39:19.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 738563 5.85 MB/sec execute 562 sec latency 9.856 ms 2026-02-20T02:39:19.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 106628575 848.76 MB/sec execute 562 sec latency 55.646 ms 2026-02-20T02:39:20.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 739061 5.85 MB/sec execute 563 sec latency 38.285 ms 2026-02-20T02:39:20.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 106671103 847.66 MB/sec execute 563 sec latency 81.881 ms 2026-02-20T02:39:21.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:20 trial098 ceph-mon[38923]: pgmap v461: 129 pgs: 129 active+clean; 198 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.8 MiB/s wr, 122 op/s 2026-02-20T02:39:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:20 trial106 ceph-mon[44052]: pgmap v461: 129 pgs: 129 active+clean; 198 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 2.8 MiB/s wr, 122 op/s 2026-02-20T02:39:21.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 740181 5.84 MB/sec execute 564 sec latency 8.007 ms 2026-02-20T02:39:21.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 106832089 847.73 MB/sec execute 564 sec latency 0.340 ms 2026-02-20T02:39:22.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 741354 5.84 MB/sec execute 565 sec latency 8.257 ms 2026-02-20T02:39:22.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 106995541 847.79 MB/sec execute 565 sec latency 0.322 ms 2026-02-20T02:39:23.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:22 trial098 ceph-mon[38923]: pgmap v462: 129 pgs: 129 active+clean; 198 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:39:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:22 trial106 ceph-mon[44052]: pgmap v462: 129 pgs: 129 active+clean; 198 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.4 MiB/s wr, 122 op/s 2026-02-20T02:39:23.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 742456 5.85 MB/sec execute 566 sec latency 7.872 ms 2026-02-20T02:39:23.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 107156495 847.83 MB/sec execute 566 sec latency 5.228 ms 2026-02-20T02:39:24.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 743303 5.84 MB/sec execute 567 sec latency 8.083 ms 2026-02-20T02:39:24.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 107316789 847.89 MB/sec execute 567 sec latency 0.266 ms 2026-02-20T02:39:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:24 trial098 ceph-mon[38923]: pgmap v463: 129 pgs: 129 active+clean; 198 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 123 op/s 2026-02-20T02:39:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:24 trial106 ceph-mon[44052]: pgmap v463: 129 pgs: 129 active+clean; 198 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 123 op/s 2026-02-20T02:39:25.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 744490 5.84 MB/sec execute 568 sec latency 7.491 ms 2026-02-20T02:39:25.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 107478429 847.92 MB/sec execute 568 sec latency 2.327 ms 2026-02-20T02:39:26.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 745680 5.85 MB/sec execute 569 sec latency 7.395 ms 2026-02-20T02:39:26.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 107639389 847.96 MB/sec execute 569 sec latency 0.673 ms 2026-02-20T02:39:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:26 trial098 ceph-mon[38923]: pgmap v464: 129 pgs: 129 active+clean; 200 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2026-02-20T02:39:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:26 trial106 ceph-mon[44052]: pgmap v464: 129 pgs: 129 active+clean; 200 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2026-02-20T02:39:27.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 746549 5.84 MB/sec execute 570 sec latency 8.119 ms 2026-02-20T02:39:27.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 107798626 848.00 MB/sec execute 570 sec latency 0.910 ms 2026-02-20T02:39:28.131 INFO:tasks.workunit.client.1.trial106.stdout: 1 747559 5.84 MB/sec execute 571 sec latency 7.867 ms 2026-02-20T02:39:28.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 107959538 848.05 MB/sec execute 571 sec latency 3.885 ms 2026-02-20T02:39:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:28 trial098 ceph-mon[38923]: pgmap v465: 129 pgs: 129 active+clean; 201 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 117 op/s 2026-02-20T02:39:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:39:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:39:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:39:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:39:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:28 trial106 ceph-mon[44052]: pgmap v465: 129 pgs: 129 active+clean; 201 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 117 op/s 2026-02-20T02:39:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:39:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:39:29.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:39:29.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:39:29.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 748954 5.85 MB/sec execute 572 sec latency 7.548 ms 2026-02-20T02:39:29.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 108122920 848.10 MB/sec execute 572 sec latency 0.267 ms 2026-02-20T02:39:30.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 749685 5.84 MB/sec execute 573 sec latency 8.725 ms 2026-02-20T02:39:30.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 108283311 848.16 MB/sec execute 573 sec latency 0.283 ms 2026-02-20T02:39:31.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:30 trial098 ceph-mon[38923]: pgmap v466: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2026-02-20T02:39:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:30 trial106 ceph-mon[44052]: pgmap v466: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2026-02-20T02:39:31.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 750544 5.84 MB/sec execute 574 sec latency 31.371 ms 2026-02-20T02:39:31.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 108384992 847.64 MB/sec execute 574 sec latency 72.024 ms 2026-02-20T02:39:32.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 751651 5.84 MB/sec execute 575 sec latency 7.864 ms 2026-02-20T02:39:32.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 108546042 847.67 MB/sec execute 575 sec latency 0.272 ms 2026-02-20T02:39:33.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:32 trial098 ceph-mon[38923]: pgmap v467: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.3 MiB/s wr, 112 op/s 2026-02-20T02:39:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:32 trial106 ceph-mon[44052]: pgmap v467: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.3 MiB/s wr, 112 op/s 2026-02-20T02:39:33.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 752883 5.84 MB/sec execute 576 sec latency 7.784 ms 2026-02-20T02:39:33.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 108704992 847.72 MB/sec execute 576 sec latency 4.841 ms 2026-02-20T02:39:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:39:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:39:34.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 753730 5.84 MB/sec execute 577 sec latency 8.467 ms 2026-02-20T02:39:34.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 108865898 847.75 MB/sec execute 577 sec latency 0.589 ms 2026-02-20T02:39:35.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:34 trial098 ceph-mon[38923]: pgmap v468: 129 pgs: 129 active+clean; 201 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.8 MiB/s wr, 118 op/s 2026-02-20T02:39:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:34 trial106 ceph-mon[44052]: pgmap v468: 129 pgs: 129 active+clean; 201 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.8 MiB/s wr, 118 op/s 2026-02-20T02:39:35.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 754918 5.84 MB/sec execute 578 sec latency 6.846 ms 2026-02-20T02:39:35.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 109029270 847.81 MB/sec execute 578 sec latency 0.259 ms 2026-02-20T02:39:36.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 756106 5.84 MB/sec execute 579 sec latency 8.809 ms 2026-02-20T02:39:36.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 109188510 847.86 MB/sec execute 579 sec latency 0.281 ms 2026-02-20T02:39:37.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:36 trial098 ceph-mon[38923]: pgmap v469: 129 pgs: 129 active+clean; 204 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2026-02-20T02:39:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:36 trial106 ceph-mon[44052]: pgmap v469: 129 pgs: 129 active+clean; 204 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2026-02-20T02:39:37.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 757027 5.84 MB/sec execute 580 sec latency 8.243 ms 2026-02-20T02:39:37.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 109350863 847.90 MB/sec execute 580 sec latency 0.583 ms 2026-02-20T02:39:38.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 758164 5.84 MB/sec execute 581 sec latency 7.760 ms 2026-02-20T02:39:38.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 109509291 847.91 MB/sec execute 581 sec latency 7.428 ms 2026-02-20T02:39:39.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:38 trial098 ceph-mon[38923]: pgmap v470: 129 pgs: 129 active+clean; 204 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.3 MiB/s wr, 116 op/s 2026-02-20T02:39:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:38 trial106 ceph-mon[44052]: pgmap v470: 129 pgs: 129 active+clean; 204 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.3 MiB/s wr, 116 op/s 2026-02-20T02:39:39.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 759486 5.84 MB/sec execute 582 sec latency 9.916 ms 2026-02-20T02:39:39.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 109667720 847.95 MB/sec execute 582 sec latency 0.561 ms 2026-02-20T02:39:40.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 760307 5.84 MB/sec execute 583 sec latency 8.586 ms 2026-02-20T02:39:40.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 109827751 847.98 MB/sec execute 583 sec latency 8.135 ms 2026-02-20T02:39:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:40 trial098 ceph-mon[38923]: pgmap v471: 129 pgs: 129 active+clean; 206 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:39:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:40 trial106 ceph-mon[44052]: pgmap v471: 129 pgs: 129 active+clean; 206 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-20T02:39:41.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 761326 5.84 MB/sec execute 584 sec latency 8.203 ms 2026-02-20T02:39:41.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 109990506 848.03 MB/sec execute 584 sec latency 0.256 ms 2026-02-20T02:39:42.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 762420 5.84 MB/sec execute 585 sec latency 7.214 ms 2026-02-20T02:39:42.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 110150934 848.09 MB/sec execute 585 sec latency 0.269 ms 2026-02-20T02:39:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:42 trial098 ceph-mon[38923]: pgmap v472: 129 pgs: 129 active+clean; 207 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.3 MiB/s wr, 119 op/s 2026-02-20T02:39:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:42 trial106 ceph-mon[44052]: pgmap v472: 129 pgs: 129 active+clean; 207 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.3 MiB/s wr, 119 op/s 2026-02-20T02:39:43.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 763627 5.84 MB/sec execute 586 sec latency 9.698 ms 2026-02-20T02:39:43.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 110311681 848.12 MB/sec execute 586 sec latency 0.246 ms 2026-02-20T02:39:44.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 764390 5.84 MB/sec execute 587 sec latency 7.995 ms 2026-02-20T02:39:44.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 110471937 848.18 MB/sec execute 587 sec latency 1.174 ms 2026-02-20T02:39:45.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:44 trial098 ceph-mon[38923]: pgmap v473: 129 pgs: 129 active+clean; 206 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 3.0 MiB/s wr, 135 op/s 2026-02-20T02:39:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:44 trial106 ceph-mon[44052]: pgmap v473: 129 pgs: 129 active+clean; 206 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 3.0 MiB/s wr, 135 op/s 2026-02-20T02:39:45.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 765571 5.83 MB/sec execute 588 sec latency 7.418 ms 2026-02-20T02:39:45.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 110634860 848.23 MB/sec execute 588 sec latency 0.256 ms 2026-02-20T02:39:46.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 766738 5.84 MB/sec execute 589 sec latency 6.818 ms 2026-02-20T02:39:46.373 INFO:tasks.workunit.client.0.trial098.stdout: 1 110795526 848.26 MB/sec execute 589 sec latency 0.260 ms 2026-02-20T02:39:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:46 trial098 ceph-mon[38923]: pgmap v474: 129 pgs: 129 active+clean; 208 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:39:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:46 trial106 ceph-mon[44052]: pgmap v474: 129 pgs: 129 active+clean; 208 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.6 MiB/s wr, 133 op/s 2026-02-20T02:39:47.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 767667 5.84 MB/sec execute 590 sec latency 6.798 ms 2026-02-20T02:39:47.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 110953503 848.29 MB/sec execute 590 sec latency 0.275 ms 2026-02-20T02:39:48.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 768821 5.84 MB/sec execute 591 sec latency 7.754 ms 2026-02-20T02:39:48.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 111116721 848.34 MB/sec execute 591 sec latency 0.252 ms 2026-02-20T02:39:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:48 trial098 ceph-mon[38923]: pgmap v475: 129 pgs: 129 active+clean; 211 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-20T02:39:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:39:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:48 trial106 ceph-mon[44052]: pgmap v475: 129 pgs: 129 active+clean; 211 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-20T02:39:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:39:49.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 769986 5.84 MB/sec execute 592 sec latency 7.841 ms 2026-02-20T02:39:49.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 111278331 848.38 MB/sec execute 592 sec latency 0.261 ms 2026-02-20T02:39:50.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 770937 5.84 MB/sec execute 593 sec latency 8.930 ms 2026-02-20T02:39:50.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 111440175 848.45 MB/sec execute 593 sec latency 0.297 ms 2026-02-20T02:39:51.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:50 trial098 ceph-mon[38923]: pgmap v476: 129 pgs: 129 active+clean; 210 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 132 op/s 2026-02-20T02:39:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:50 trial106 ceph-mon[44052]: pgmap v476: 129 pgs: 129 active+clean; 210 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 2.9 MiB/s wr, 132 op/s 2026-02-20T02:39:51.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 771961 5.84 MB/sec execute 594 sec latency 7.372 ms 2026-02-20T02:39:51.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 111599430 848.47 MB/sec execute 594 sec latency 0.276 ms 2026-02-20T02:39:52.133 INFO:tasks.workunit.client.1.trial106.stdout: 1 772993 5.83 MB/sec execute 595 sec latency 23.282 ms 2026-02-20T02:39:52.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 111753010 848.44 MB/sec execute 595 sec latency 59.570 ms 2026-02-20T02:39:53.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:52 trial098 ceph-mon[38923]: pgmap v477: 129 pgs: 129 active+clean; 202 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 130 op/s 2026-02-20T02:39:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:52 trial106 ceph-mon[44052]: pgmap v477: 129 pgs: 129 active+clean; 202 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.5 MiB/s wr, 130 op/s 2026-02-20T02:39:53.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 774259 5.84 MB/sec execute 596 sec latency 6.937 ms 2026-02-20T02:39:53.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 111914145 848.50 MB/sec execute 596 sec latency 0.776 ms 2026-02-20T02:39:54.133 INFO:tasks.workunit.client.1.trial106.stdout: 1 775157 5.84 MB/sec execute 597 sec latency 8.477 ms 2026-02-20T02:39:54.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 112076572 848.54 MB/sec execute 597 sec latency 8.389 ms 2026-02-20T02:39:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:54 trial098 ceph-mon[38923]: pgmap v478: 129 pgs: 129 active+clean; 203 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2026-02-20T02:39:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:54 trial106 ceph-mon[44052]: pgmap v478: 129 pgs: 129 active+clean; 203 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2026-02-20T02:39:55.132 INFO:tasks.workunit.client.1.trial106.stdout: 1 776371 5.83 MB/sec execute 598 sec latency 7.656 ms 2026-02-20T02:39:55.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 112239387 848.59 MB/sec execute 598 sec latency 0.251 ms 2026-02-20T02:39:56.133 INFO:tasks.workunit.client.1.trial106.stdout: 1 777559 5.84 MB/sec execute 599 sec latency 9.602 ms 2026-02-20T02:39:56.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 112396934 848.62 MB/sec execute 599 sec latency 4.818 ms 2026-02-20T02:39:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:56 trial098 ceph-mon[38923]: pgmap v479: 129 pgs: 129 active+clean; 192 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:39:57.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:56 trial106 ceph-mon[44052]: pgmap v479: 129 pgs: 129 active+clean; 192 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-20T02:39:57.133 INFO:tasks.workunit.client.1.trial106.stdout: 1 cleanup 600 sec 2026-02-20T02:39:57.374 INFO:tasks.workunit.client.0.trial098.stdout: 1 cleanup 600 sec 2026-02-20T02:39:57.396 INFO:tasks.workunit.client.0.trial098.stdout: 0 cleanup 600 sec 2026-02-20T02:39:57.396 INFO:tasks.workunit.client.0.trial098.stdout: 2026-02-20T02:39:57.396 INFO:tasks.workunit.client.0.trial098.stdout: Operation Count AvgLat MaxLat 2026-02-20T02:39:57.396 INFO:tasks.workunit.client.0.trial098.stdout: ---------------------------------------- 2026-02-20T02:39:57.396 INFO:tasks.workunit.client.0.trial098.stdout: NTCreateX 16196367 0.007 1.641 2026-02-20T02:39:57.396 INFO:tasks.workunit.client.0.trial098.stdout: Close 11897402 0.001 0.656 2026-02-20T02:39:57.396 INFO:tasks.workunit.client.0.trial098.stdout: Rename 685832 0.015 0.574 2026-02-20T02:39:57.396 INFO:tasks.workunit.client.0.trial098.stdout: Unlink 3270722 0.013 1.775 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: Deltree 410 1.695 4.424 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: Mkdir 205 0.002 0.005 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: Qpathinfo 14680381 0.003 2.022 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: Qfileinfo 2572700 0.001 0.673 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: Qfsinfo 2691809 0.001 0.164 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: Sfileinfo 1319336 0.003 0.279 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: Find 5675777 0.012 1.416 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: WriteX 8075299 0.007 1.287 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: ReadX 25388910 0.001 0.798 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: LockX 52740 0.002 0.090 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: UnlockX 52740 0.001 0.089 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: Flush 1135151 0.119 95.638 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout:Throughput 848.623 MB/sec 1 clients 1 procs max_latency=95.641 ms 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stderr:+ dbench 10 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout: 2026-02-20T02:39:57.397 INFO:tasks.workunit.client.0.trial098.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-20T02:39:57.398 INFO:tasks.workunit.client.0.trial098.stdout:9 of 10 processes prepared for launch 0 sec 2026-02-20T02:39:57.402 INFO:tasks.workunit.client.1.trial106.stdout: 0 cleanup 600 sec 2026-02-20T02:39:57.402 INFO:tasks.workunit.client.1.trial106.stdout: 2026-02-20T02:39:57.402 INFO:tasks.workunit.client.1.trial106.stdout: Operation Count AvgLat MaxLat 2026-02-20T02:39:57.402 INFO:tasks.workunit.client.1.trial106.stdout: ---------------------------------------- 2026-02-20T02:39:57.402 INFO:tasks.workunit.client.1.trial106.stdout: NTCreateX 111815 1.673 38.026 2026-02-20T02:39:57.402 INFO:tasks.workunit.client.1.trial106.stdout: Close 82099 0.020 0.722 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Rename 4733 4.308 32.225 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Unlink 22616 1.668 37.861 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Deltree 2 72.146 112.246 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Mkdir 1 0.196 0.196 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Qpathinfo 101379 0.984 35.756 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Qfileinfo 17726 0.056 0.970 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Qfsinfo 18581 0.171 2.882 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Sfileinfo 9106 0.542 1.484 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Find 39182 5.800 49.782 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: WriteX 55566 0.096 1.031 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: ReadX 175235 0.002 0.097 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: LockX 364 0.255 0.376 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: UnlockX 364 0.250 0.513 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: Flush 7832 1.317 28.803 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout: 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stdout:Throughput 5.84263 MB/sec 1 clients 1 procs max_latency=49.786 ms 2026-02-20T02:39:57.403 INFO:tasks.workunit.client.1.trial106.stderr:+ dbench 10 2026-02-20T02:39:57.404 INFO:tasks.workunit.client.1.trial106.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-20T02:39:57.404 INFO:tasks.workunit.client.1.trial106.stdout: 2026-02-20T02:39:57.404 INFO:tasks.workunit.client.1.trial106.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-20T02:39:57.404 INFO:tasks.workunit.client.1.trial106.stdout:8 of 10 processes prepared for launch 0 sec 2026-02-20T02:39:57.498 INFO:tasks.workunit.client.0.trial098.stdout:10 of 10 processes prepared for launch 0 sec 2026-02-20T02:39:57.498 INFO:tasks.workunit.client.0.trial098.stdout:releasing clients 2026-02-20T02:39:57.504 INFO:tasks.workunit.client.1.trial106.stdout:10 of 10 processes prepared for launch 0 sec 2026-02-20T02:39:57.504 INFO:tasks.workunit.client.1.trial106.stdout:releasing clients 2026-02-20T02:39:58.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 92832 5178.13 MB/sec warmup 1 sec latency 45.189 ms 2026-02-20T02:39:58.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 455 159.72 MB/sec warmup 1 sec latency 19.279 ms 2026-02-20T02:39:59.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:39:58 trial106 ceph-mon[44052]: pgmap v480: 129 pgs: 129 active+clean; 191 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 127 op/s 2026-02-20T02:39:59.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:39:58 trial098 ceph-mon[38923]: pgmap v480: 129 pgs: 129 active+clean; 191 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.3 KiB/s rd, 2.4 MiB/s wr, 127 op/s 2026-02-20T02:39:59.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 188213 5159.60 MB/sec warmup 2 sec latency 12.686 ms 2026-02-20T02:39:59.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 813 107.41 MB/sec warmup 2 sec latency 42.539 ms 2026-02-20T02:40:00.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 286178 5199.07 MB/sec warmup 3 sec latency 12.642 ms 2026-02-20T02:40:00.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 1058 76.31 MB/sec warmup 3 sec latency 42.094 ms 2026-02-20T02:40:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:00 trial106 ceph-mon[44052]: pgmap v481: 129 pgs: 129 active+clean; 249 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 7.2 MiB/s wr, 116 op/s 2026-02-20T02:40:01.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:00 trial106 ceph-mon[44052]: overall HEALTH_OK 2026-02-20T02:40:01.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:00 trial098 ceph-mon[38923]: pgmap v481: 129 pgs: 129 active+clean; 249 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 7.2 MiB/s wr, 116 op/s 2026-02-20T02:40:01.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:00 trial098 ceph-mon[38923]: overall HEALTH_OK 2026-02-20T02:40:01.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 384313 5224.03 MB/sec warmup 4 sec latency 2.287 ms 2026-02-20T02:40:01.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 1311 60.00 MB/sec warmup 4 sec latency 44.448 ms 2026-02-20T02:40:02.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 481120 5255.55 MB/sec warmup 5 sec latency 2.623 ms 2026-02-20T02:40:02.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 1583 52.30 MB/sec warmup 5 sec latency 66.277 ms 2026-02-20T02:40:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:02 trial106 ceph-mon[44052]: pgmap v482: 129 pgs: 129 active+clean; 317 MiB data, 2.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 13 MiB/s wr, 159 op/s 2026-02-20T02:40:03.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:02 trial098 ceph-mon[38923]: pgmap v482: 129 pgs: 129 active+clean; 317 MiB data, 2.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 13 MiB/s wr, 159 op/s 2026-02-20T02:40:03.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 539365 4902.07 MB/sec warmup 6 sec latency 68.434 ms 2026-02-20T02:40:03.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 1779 43.82 MB/sec warmup 6 sec latency 106.631 ms 2026-02-20T02:40:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:40:04.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:40:04.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 636101 4947.56 MB/sec warmup 7 sec latency 14.132 ms 2026-02-20T02:40:04.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 2001 37.87 MB/sec warmup 7 sec latency 70.180 ms 2026-02-20T02:40:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:04 trial106 ceph-mon[44052]: pgmap v483: 129 pgs: 129 active+clean; 378 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 20 MiB/s wr, 194 op/s 2026-02-20T02:40:05.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:04 trial098 ceph-mon[38923]: pgmap v483: 129 pgs: 129 active+clean; 378 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 20 MiB/s wr, 194 op/s 2026-02-20T02:40:05.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 732874 4981.11 MB/sec warmup 8 sec latency 2.713 ms 2026-02-20T02:40:05.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 2246 33.67 MB/sec warmup 8 sec latency 43.201 ms 2026-02-20T02:40:06.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 827748 4995.60 MB/sec warmup 9 sec latency 9.392 ms 2026-02-20T02:40:06.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 2455 31.57 MB/sec warmup 9 sec latency 48.610 ms 2026-02-20T02:40:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:06 trial106 ceph-mon[44052]: pgmap v484: 129 pgs: 129 active+clean; 379 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 20 MiB/s wr, 233 op/s 2026-02-20T02:40:07.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:06 trial098 ceph-mon[38923]: pgmap v484: 129 pgs: 129 active+clean; 379 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 20 MiB/s wr, 233 op/s 2026-02-20T02:40:07.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 922592 5025.43 MB/sec warmup 10 sec latency 1.776 ms 2026-02-20T02:40:07.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 2777 31.97 MB/sec warmup 10 sec latency 48.093 ms 2026-02-20T02:40:08.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 1014636 5018.86 MB/sec warmup 11 sec latency 26.885 ms 2026-02-20T02:40:08.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 3268 32.12 MB/sec warmup 11 sec latency 41.263 ms 2026-02-20T02:40:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:08 trial106 ceph-mon[44052]: pgmap v485: 129 pgs: 129 active+clean; 381 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 20 MiB/s wr, 222 op/s 2026-02-20T02:40:09.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:08 trial098 ceph-mon[38923]: pgmap v485: 129 pgs: 129 active+clean; 381 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 20 MiB/s wr, 222 op/s 2026-02-20T02:40:09.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 1075355 4873.73 MB/sec warmup 12 sec latency 81.988 ms 2026-02-20T02:40:09.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 3318 29.47 MB/sec warmup 12 sec latency 99.159 ms 2026-02-20T02:40:10.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 1171027 4896.11 MB/sec warmup 13 sec latency 2.011 ms 2026-02-20T02:40:10.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 3559 29.56 MB/sec warmup 13 sec latency 46.180 ms 2026-02-20T02:40:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:10 trial106 ceph-mon[44052]: pgmap v486: 129 pgs: 129 active+clean; 393 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 21 MiB/s wr, 261 op/s 2026-02-20T02:40:11.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:10 trial098 ceph-mon[38923]: pgmap v486: 129 pgs: 129 active+clean; 393 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 21 MiB/s wr, 261 op/s 2026-02-20T02:40:11.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 1266339 4912.62 MB/sec warmup 14 sec latency 1.798 ms 2026-02-20T02:40:11.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 3793 28.40 MB/sec warmup 14 sec latency 47.137 ms 2026-02-20T02:40:12.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 1362012 4928.63 MB/sec warmup 15 sec latency 2.661 ms 2026-02-20T02:40:12.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 3942 26.71 MB/sec warmup 15 sec latency 46.369 ms 2026-02-20T02:40:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:12 trial106 ceph-mon[44052]: pgmap v487: 129 pgs: 129 active+clean; 401 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 17 MiB/s wr, 257 op/s 2026-02-20T02:40:13.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:12 trial098 ceph-mon[38923]: pgmap v487: 129 pgs: 129 active+clean; 401 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 17 MiB/s wr, 257 op/s 2026-02-20T02:40:13.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 1456302 4949.30 MB/sec warmup 16 sec latency 2.287 ms 2026-02-20T02:40:13.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 4077 25.05 MB/sec warmup 16 sec latency 41.499 ms 2026-02-20T02:40:14.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 1512253 4835.55 MB/sec warmup 17 sec latency 131.148 ms 2026-02-20T02:40:14.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 4213 23.64 MB/sec warmup 17 sec latency 166.316 ms 2026-02-20T02:40:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:14 trial106 ceph-mon[44052]: pgmap v488: 129 pgs: 129 active+clean; 409 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 12 MiB/s wr, 246 op/s 2026-02-20T02:40:15.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:14 trial098 ceph-mon[38923]: pgmap v488: 129 pgs: 129 active+clean; 409 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 12 MiB/s wr, 246 op/s 2026-02-20T02:40:15.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 1582980 4778.75 MB/sec warmup 18 sec latency 85.012 ms 2026-02-20T02:40:15.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 4443 22.64 MB/sec warmup 18 sec latency 110.853 ms 2026-02-20T02:40:16.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 1676679 4793.16 MB/sec warmup 19 sec latency 19.741 ms 2026-02-20T02:40:16.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 4682 22.15 MB/sec warmup 19 sec latency 55.346 ms 2026-02-20T02:40:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:16 trial106 ceph-mon[44052]: pgmap v489: 129 pgs: 129 active+clean; 413 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.2 MiB/s wr, 224 op/s 2026-02-20T02:40:17.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:16 trial098 ceph-mon[38923]: pgmap v489: 129 pgs: 129 active+clean; 413 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.2 MiB/s wr, 224 op/s 2026-02-20T02:40:17.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 1772144 4811.01 MB/sec warmup 20 sec latency 2.403 ms 2026-02-20T02:40:17.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 4971 22.56 MB/sec warmup 20 sec latency 54.012 ms 2026-02-20T02:40:18.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 1867360 4834.56 MB/sec warmup 21 sec latency 1.817 ms 2026-02-20T02:40:18.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 5190 21.57 MB/sec warmup 21 sec latency 41.331 ms 2026-02-20T02:40:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:18 trial106 ceph-mon[44052]: pgmap v490: 129 pgs: 129 active+clean; 409 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 6.0 MiB/s wr, 183 op/s 2026-02-20T02:40:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:40:19.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:18 trial098 ceph-mon[38923]: pgmap v490: 129 pgs: 129 active+clean; 409 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 6.0 MiB/s wr, 183 op/s 2026-02-20T02:40:19.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:40:19.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 1961854 4846.17 MB/sec warmup 22 sec latency 25.411 ms 2026-02-20T02:40:19.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 5435 20.68 MB/sec warmup 22 sec latency 41.327 ms 2026-02-20T02:40:20.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2058595 4862.04 MB/sec warmup 23 sec latency 2.413 ms 2026-02-20T02:40:20.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 5679 19.91 MB/sec warmup 23 sec latency 37.384 ms 2026-02-20T02:40:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:20 trial106 ceph-mon[44052]: pgmap v491: 129 pgs: 129 active+clean; 405 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 245 op/s 2026-02-20T02:40:21.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:20 trial098 ceph-mon[38923]: pgmap v491: 129 pgs: 129 active+clean; 405 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 245 op/s 2026-02-20T02:40:21.498 INFO:tasks.workunit.client.0.trial098.stdout: 10 2155031 4876.40 MB/sec warmup 24 sec latency 3.230 ms 2026-02-20T02:40:21.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 5937 19.61 MB/sec warmup 24 sec latency 41.619 ms 2026-02-20T02:40:22.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2250407 4886.73 MB/sec warmup 25 sec latency 2.417 ms 2026-02-20T02:40:22.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 6180 19.48 MB/sec warmup 25 sec latency 44.401 ms 2026-02-20T02:40:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:22 trial106 ceph-mon[44052]: pgmap v492: 129 pgs: 129 active+clean; 394 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.5 MiB/s wr, 231 op/s 2026-02-20T02:40:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:22 trial098 ceph-mon[38923]: pgmap v492: 129 pgs: 129 active+clean; 394 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.5 MiB/s wr, 231 op/s 2026-02-20T02:40:23.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2344578 4900.72 MB/sec warmup 26 sec latency 2.675 ms 2026-02-20T02:40:23.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 6604 20.33 MB/sec warmup 26 sec latency 42.821 ms 2026-02-20T02:40:24.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2439343 4908.17 MB/sec warmup 27 sec latency 3.016 ms 2026-02-20T02:40:24.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 6867 20.18 MB/sec warmup 27 sec latency 40.860 ms 2026-02-20T02:40:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:24 trial098 ceph-mon[38923]: pgmap v493: 129 pgs: 129 active+clean; 399 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.2 MiB/s wr, 242 op/s 2026-02-20T02:40:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:24 trial106 ceph-mon[44052]: pgmap v493: 129 pgs: 129 active+clean; 399 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.2 MiB/s wr, 242 op/s 2026-02-20T02:40:25.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2527881 4903.63 MB/sec warmup 28 sec latency 59.202 ms 2026-02-20T02:40:25.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 7036 20.13 MB/sec warmup 28 sec latency 69.731 ms 2026-02-20T02:40:26.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2623803 4913.13 MB/sec warmup 29 sec latency 1.562 ms 2026-02-20T02:40:26.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 7301 20.16 MB/sec warmup 29 sec latency 65.272 ms 2026-02-20T02:40:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:26 trial106 ceph-mon[44052]: pgmap v494: 129 pgs: 129 active+clean; 404 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 253 op/s 2026-02-20T02:40:27.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:26 trial098 ceph-mon[38923]: pgmap v494: 129 pgs: 129 active+clean; 404 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 253 op/s 2026-02-20T02:40:27.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2719735 4921.57 MB/sec warmup 30 sec latency 3.048 ms 2026-02-20T02:40:27.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 7460 19.69 MB/sec warmup 30 sec latency 72.416 ms 2026-02-20T02:40:28.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2813882 4931.85 MB/sec warmup 31 sec latency 2.086 ms 2026-02-20T02:40:28.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 7603 19.10 MB/sec warmup 31 sec latency 41.967 ms 2026-02-20T02:40:29.116 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:28 trial098 ceph-mon[38923]: pgmap v495: 129 pgs: 129 active+clean; 394 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 5.6 MiB/s wr, 244 op/s 2026-02-20T02:40:29.116 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:40:29.117 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:40:29.117 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:40:29.117 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:40:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:28 trial106 ceph-mon[44052]: pgmap v495: 129 pgs: 129 active+clean; 394 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 5.6 MiB/s wr, 244 op/s 2026-02-20T02:40:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:40:29.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:40:29.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:40:29.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:40:29.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2909536 4938.83 MB/sec warmup 32 sec latency 4.332 ms 2026-02-20T02:40:29.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 7802 18.56 MB/sec warmup 32 sec latency 59.061 ms 2026-02-20T02:40:30.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2954802 4863.14 MB/sec warmup 33 sec latency 72.352 ms 2026-02-20T02:40:30.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 7982 18.14 MB/sec warmup 33 sec latency 111.509 ms 2026-02-20T02:40:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:30 trial106 ceph-mon[44052]: pgmap v496: 129 pgs: 129 active+clean; 404 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 278 op/s 2026-02-20T02:40:31.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:30 trial098 ceph-mon[38923]: pgmap v496: 129 pgs: 129 active+clean; 404 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 278 op/s 2026-02-20T02:40:31.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 2973832 4750.14 MB/sec warmup 34 sec latency 122.711 ms 2026-02-20T02:40:31.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 8107 17.79 MB/sec warmup 34 sec latency 136.170 ms 2026-02-20T02:40:32.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3069005 4761.09 MB/sec warmup 35 sec latency 16.827 ms 2026-02-20T02:40:32.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 8360 17.68 MB/sec warmup 35 sec latency 57.278 ms 2026-02-20T02:40:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:32 trial106 ceph-mon[44052]: pgmap v497: 129 pgs: 129 active+clean; 404 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.1 MiB/s wr, 205 op/s 2026-02-20T02:40:33.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:32 trial098 ceph-mon[38923]: pgmap v497: 129 pgs: 129 active+clean; 404 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.1 MiB/s wr, 205 op/s 2026-02-20T02:40:33.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3165045 4772.81 MB/sec warmup 36 sec latency 1.961 ms 2026-02-20T02:40:33.504 INFO:tasks.workunit.client.1.trial106.stdout: 10 8638 17.87 MB/sec warmup 36 sec latency 43.144 ms 2026-02-20T02:40:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:40:34.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:40:34.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3259788 4786.22 MB/sec warmup 37 sec latency 2.879 ms 2026-02-20T02:40:34.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 8877 17.44 MB/sec warmup 37 sec latency 41.067 ms 2026-02-20T02:40:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:34 trial106 ceph-mon[44052]: pgmap v498: 129 pgs: 129 active+clean; 394 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.3 MiB/s wr, 204 op/s 2026-02-20T02:40:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:34 trial098 ceph-mon[38923]: pgmap v498: 129 pgs: 129 active+clean; 394 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.3 MiB/s wr, 204 op/s 2026-02-20T02:40:35.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3352793 4792.53 MB/sec warmup 38 sec latency 28.525 ms 2026-02-20T02:40:35.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 9129 17.05 MB/sec warmup 38 sec latency 50.260 ms 2026-02-20T02:40:36.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3449487 4803.23 MB/sec warmup 39 sec latency 3.393 ms 2026-02-20T02:40:36.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 9386 16.83 MB/sec warmup 39 sec latency 36.270 ms 2026-02-20T02:40:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:36 trial106 ceph-mon[44052]: pgmap v499: 129 pgs: 129 active+clean; 387 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 263 op/s 2026-02-20T02:40:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:36 trial098 ceph-mon[38923]: pgmap v499: 129 pgs: 129 active+clean; 387 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 263 op/s 2026-02-20T02:40:37.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3544709 4811.51 MB/sec warmup 40 sec latency 1.964 ms 2026-02-20T02:40:37.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 9600 16.69 MB/sec warmup 40 sec latency 42.231 ms 2026-02-20T02:40:38.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3639604 4818.87 MB/sec warmup 41 sec latency 2.544 ms 2026-02-20T02:40:38.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 9980 17.32 MB/sec warmup 41 sec latency 46.226 ms 2026-02-20T02:40:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:38 trial106 ceph-mon[44052]: pgmap v500: 129 pgs: 129 active+clean; 386 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.3 MiB/s wr, 234 op/s 2026-02-20T02:40:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:38 trial098 ceph-mon[38923]: pgmap v500: 129 pgs: 129 active+clean; 386 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.3 MiB/s wr, 234 op/s 2026-02-20T02:40:39.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3733392 4828.44 MB/sec warmup 42 sec latency 3.844 ms 2026-02-20T02:40:39.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 10389 17.52 MB/sec warmup 42 sec latency 38.957 ms 2026-02-20T02:40:40.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3827725 4834.54 MB/sec warmup 43 sec latency 23.179 ms 2026-02-20T02:40:40.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 10479 17.26 MB/sec warmup 43 sec latency 48.675 ms 2026-02-20T02:40:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:40 trial106 ceph-mon[44052]: pgmap v501: 129 pgs: 129 active+clean; 392 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 244 op/s 2026-02-20T02:40:41.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:40 trial098 ceph-mon[38923]: pgmap v501: 129 pgs: 129 active+clean; 392 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 244 op/s 2026-02-20T02:40:41.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 3923735 4842.33 MB/sec warmup 44 sec latency 3.082 ms 2026-02-20T02:40:41.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 10775 17.53 MB/sec warmup 44 sec latency 55.309 ms 2026-02-20T02:40:42.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 4018858 4848.74 MB/sec warmup 45 sec latency 4.392 ms 2026-02-20T02:40:42.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 10958 17.35 MB/sec warmup 45 sec latency 75.151 ms 2026-02-20T02:40:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:42 trial106 ceph-mon[44052]: pgmap v502: 129 pgs: 129 active+clean; 406 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 5.2 MiB/s wr, 245 op/s 2026-02-20T02:40:43.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:42 trial098 ceph-mon[38923]: pgmap v502: 129 pgs: 129 active+clean; 406 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 5.2 MiB/s wr, 245 op/s 2026-02-20T02:40:43.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4115259 4857.01 MB/sec warmup 46 sec latency 2.041 ms 2026-02-20T02:40:43.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 11103 17.02 MB/sec warmup 46 sec latency 52.506 ms 2026-02-20T02:40:44.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4209782 4864.95 MB/sec warmup 47 sec latency 2.153 ms 2026-02-20T02:40:44.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 11282 16.68 MB/sec warmup 47 sec latency 54.555 ms 2026-02-20T02:40:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:44 trial106 ceph-mon[44052]: pgmap v503: 129 pgs: 129 active+clean; 411 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 5.9 MiB/s wr, 247 op/s 2026-02-20T02:40:45.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:44 trial098 ceph-mon[38923]: pgmap v503: 129 pgs: 129 active+clean; 411 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 5.9 MiB/s wr, 247 op/s 2026-02-20T02:40:45.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4303348 4868.67 MB/sec warmup 48 sec latency 13.560 ms 2026-02-20T02:40:45.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 11534 16.46 MB/sec warmup 48 sec latency 57.596 ms 2026-02-20T02:40:46.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4398385 4873.89 MB/sec warmup 49 sec latency 3.394 ms 2026-02-20T02:40:46.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 11774 16.39 MB/sec warmup 49 sec latency 54.190 ms 2026-02-20T02:40:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:46 trial106 ceph-mon[44052]: pgmap v504: 129 pgs: 129 active+clean; 415 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 245 op/s 2026-02-20T02:40:47.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:46 trial098 ceph-mon[38923]: pgmap v504: 129 pgs: 129 active+clean; 415 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 245 op/s 2026-02-20T02:40:47.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 4433347 4814.19 MB/sec warmup 50 sec latency 113.960 ms 2026-02-20T02:40:47.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 11920 16.20 MB/sec warmup 50 sec latency 145.854 ms 2026-02-20T02:40:48.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4445766 4732.85 MB/sec warmup 51 sec latency 123.898 ms 2026-02-20T02:40:48.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 12092 16.35 MB/sec warmup 51 sec latency 126.381 ms 2026-02-20T02:40:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:48 trial106 ceph-mon[44052]: pgmap v505: 129 pgs: 129 active+clean; 416 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.5 KiB/s rd, 6.2 MiB/s wr, 204 op/s 2026-02-20T02:40:49.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:40:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:48 trial098 ceph-mon[38923]: pgmap v505: 129 pgs: 129 active+clean; 416 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.5 KiB/s rd, 6.2 MiB/s wr, 204 op/s 2026-02-20T02:40:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:40:49.499 INFO:tasks.workunit.client.0.trial098.stdout: 10 4541880 4741.31 MB/sec warmup 52 sec latency 1.712 ms 2026-02-20T02:40:49.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 12320 16.07 MB/sec warmup 52 sec latency 39.471 ms 2026-02-20T02:40:50.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4636484 4751.34 MB/sec warmup 53 sec latency 7.261 ms 2026-02-20T02:40:50.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 12565 15.81 MB/sec warmup 53 sec latency 39.021 ms 2026-02-20T02:40:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:50 trial106 ceph-mon[44052]: pgmap v506: 129 pgs: 129 active+clean; 411 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 250 op/s 2026-02-20T02:40:51.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:50 trial098 ceph-mon[38923]: pgmap v506: 129 pgs: 129 active+clean; 411 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 250 op/s 2026-02-20T02:40:51.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4733362 4760.12 MB/sec warmup 54 sec latency 2.119 ms 2026-02-20T02:40:51.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 12820 15.61 MB/sec warmup 54 sec latency 38.102 ms 2026-02-20T02:40:52.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4830090 4768.45 MB/sec warmup 55 sec latency 1.897 ms 2026-02-20T02:40:52.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 13062 15.54 MB/sec warmup 55 sec latency 44.113 ms 2026-02-20T02:40:53.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:52 trial098 ceph-mon[38923]: pgmap v507: 129 pgs: 129 active+clean; 399 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 255 op/s 2026-02-20T02:40:53.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:52 trial106 ceph-mon[44052]: pgmap v507: 129 pgs: 129 active+clean; 399 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 255 op/s 2026-02-20T02:40:53.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4925534 4775.19 MB/sec warmup 56 sec latency 4.225 ms 2026-02-20T02:40:53.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 13345 15.74 MB/sec warmup 56 sec latency 47.159 ms 2026-02-20T02:40:54.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 4983941 4746.68 MB/sec warmup 57 sec latency 99.903 ms 2026-02-20T02:40:54.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 13663 15.95 MB/sec warmup 57 sec latency 111.095 ms 2026-02-20T02:40:55.136 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:54 trial098 ceph-mon[38923]: pgmap v508: 129 pgs: 129 active+clean; 400 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 4.9 MiB/s wr, 224 op/s 2026-02-20T02:40:55.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:54 trial106 ceph-mon[44052]: pgmap v508: 129 pgs: 129 active+clean; 400 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 4.9 MiB/s wr, 224 op/s 2026-02-20T02:40:55.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5075925 4753.22 MB/sec warmup 58 sec latency 14.549 ms 2026-02-20T02:40:55.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 13954 15.99 MB/sec warmup 58 sec latency 37.469 ms 2026-02-20T02:40:56.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5170712 4759.29 MB/sec warmup 59 sec latency 4.258 ms 2026-02-20T02:40:56.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 14084 15.89 MB/sec warmup 59 sec latency 49.364 ms 2026-02-20T02:40:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:56 trial106 ceph-mon[44052]: pgmap v509: 129 pgs: 129 active+clean; 400 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 276 op/s 2026-02-20T02:40:57.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:56 trial098 ceph-mon[38923]: pgmap v509: 129 pgs: 129 active+clean; 400 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 276 op/s 2026-02-20T02:40:57.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5265322 4765.02 MB/sec warmup 60 sec latency 2.815 ms 2026-02-20T02:40:57.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 14374 16.11 MB/sec warmup 60 sec latency 68.711 ms 2026-02-20T02:40:58.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5360197 4770.79 MB/sec warmup 61 sec latency 1.397 ms 2026-02-20T02:40:58.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 14543 15.95 MB/sec warmup 61 sec latency 57.408 ms 2026-02-20T02:40:58.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:40:58 trial098 ceph-mon[38923]: pgmap v510: 129 pgs: 129 active+clean; 402 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 5.6 MiB/s wr, 263 op/s 2026-02-20T02:40:58.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:40:58 trial106 ceph-mon[44052]: pgmap v510: 129 pgs: 129 active+clean; 402 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 5.6 MiB/s wr, 263 op/s 2026-02-20T02:40:59.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5422198 4747.66 MB/sec warmup 62 sec latency 125.147 ms 2026-02-20T02:40:59.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 14657 15.71 MB/sec warmup 62 sec latency 138.400 ms 2026-02-20T02:41:00.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5495144 4735.32 MB/sec warmup 63 sec latency 63.023 ms 2026-02-20T02:41:00.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 14814 15.48 MB/sec warmup 63 sec latency 107.425 ms 2026-02-20T02:41:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:00 trial098 ceph-mon[38923]: pgmap v511: 129 pgs: 129 active+clean; 403 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 232 op/s 2026-02-20T02:41:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:00 trial106 ceph-mon[44052]: pgmap v511: 129 pgs: 129 active+clean; 403 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 232 op/s 2026-02-20T02:41:01.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5588331 4741.88 MB/sec warmup 64 sec latency 2.452 ms 2026-02-20T02:41:01.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 15076 15.35 MB/sec warmup 64 sec latency 53.076 ms 2026-02-20T02:41:02.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5682022 4746.62 MB/sec warmup 65 sec latency 13.553 ms 2026-02-20T02:41:02.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 15313 15.29 MB/sec warmup 65 sec latency 50.194 ms 2026-02-20T02:41:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:02 trial098 ceph-mon[38923]: pgmap v512: 129 pgs: 129 active+clean; 412 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 6.1 MiB/s wr, 221 op/s 2026-02-20T02:41:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:02 trial106 ceph-mon[44052]: pgmap v512: 129 pgs: 129 active+clean; 412 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 6.1 MiB/s wr, 221 op/s 2026-02-20T02:41:03.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5776834 4752.16 MB/sec warmup 66 sec latency 4.260 ms 2026-02-20T02:41:03.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 15571 15.36 MB/sec warmup 66 sec latency 58.574 ms 2026-02-20T02:41:04.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:41:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:41:04.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5872377 4758.09 MB/sec warmup 67 sec latency 2.842 ms 2026-02-20T02:41:04.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 15825 15.32 MB/sec warmup 67 sec latency 44.081 ms 2026-02-20T02:41:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:04 trial098 ceph-mon[38923]: pgmap v513: 129 pgs: 129 active+clean; 408 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 6.3 MiB/s wr, 218 op/s 2026-02-20T02:41:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:04 trial106 ceph-mon[44052]: pgmap v513: 129 pgs: 129 active+clean; 408 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 6.3 MiB/s wr, 218 op/s 2026-02-20T02:41:05.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 5965878 4764.20 MB/sec warmup 68 sec latency 16.725 ms 2026-02-20T02:41:05.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 16076 15.13 MB/sec warmup 68 sec latency 41.396 ms 2026-02-20T02:41:06.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 6061549 4770.63 MB/sec warmup 69 sec latency 2.403 ms 2026-02-20T02:41:06.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 16333 14.98 MB/sec warmup 69 sec latency 39.160 ms 2026-02-20T02:41:07.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:06 trial098 ceph-mon[38923]: pgmap v514: 129 pgs: 129 active+clean; 402 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 270 op/s 2026-02-20T02:41:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:06 trial106 ceph-mon[44052]: pgmap v514: 129 pgs: 129 active+clean; 402 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 270 op/s 2026-02-20T02:41:07.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 6156910 4775.85 MB/sec warmup 70 sec latency 2.172 ms 2026-02-20T02:41:07.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 16578 14.93 MB/sec warmup 70 sec latency 39.159 ms 2026-02-20T02:41:08.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 6252297 4780.98 MB/sec warmup 71 sec latency 3.881 ms 2026-02-20T02:41:08.505 INFO:tasks.workunit.client.1.trial106.stdout: 10 16844 15.00 MB/sec warmup 71 sec latency 44.455 ms 2026-02-20T02:41:09.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:08 trial098 ceph-mon[38923]: pgmap v515: 129 pgs: 129 active+clean; 392 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.9 MiB/s wr, 245 op/s 2026-02-20T02:41:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:08 trial106 ceph-mon[44052]: pgmap v515: 129 pgs: 129 active+clean; 392 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.9 MiB/s wr, 245 op/s 2026-02-20T02:41:09.500 INFO:tasks.workunit.client.0.trial098.stdout: 10 6347478 4785.77 MB/sec warmup 72 sec latency 1.718 ms 2026-02-20T02:41:09.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 17296 15.36 MB/sec warmup 72 sec latency 47.434 ms 2026-02-20T02:41:10.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 6431878 4784.67 MB/sec warmup 73 sec latency 56.813 ms 2026-02-20T02:41:10.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 17506 15.32 MB/sec warmup 73 sec latency 40.101 ms 2026-02-20T02:41:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:10 trial098 ceph-mon[38923]: pgmap v516: 129 pgs: 129 active+clean; 395 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 252 op/s 2026-02-20T02:41:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:10 trial106 ceph-mon[44052]: pgmap v516: 129 pgs: 129 active+clean; 395 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 252 op/s 2026-02-20T02:41:11.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 6527053 4789.56 MB/sec warmup 74 sec latency 2.524 ms 2026-02-20T02:41:11.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 17708 15.38 MB/sec warmup 74 sec latency 40.110 ms 2026-02-20T02:41:12.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 6623207 4794.82 MB/sec warmup 75 sec latency 1.898 ms 2026-02-20T02:41:12.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 17960 15.45 MB/sec warmup 75 sec latency 83.328 ms 2026-02-20T02:41:13.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:12 trial098 ceph-mon[38923]: pgmap v517: 129 pgs: 129 active+clean; 408 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.6 MiB/s wr, 294 op/s 2026-02-20T02:41:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:12 trial106 ceph-mon[44052]: pgmap v517: 129 pgs: 129 active+clean; 408 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.6 MiB/s wr, 294 op/s 2026-02-20T02:41:13.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 6719315 4799.90 MB/sec warmup 76 sec latency 1.650 ms 2026-02-20T02:41:13.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 18119 15.32 MB/sec warmup 76 sec latency 52.536 ms 2026-02-20T02:41:14.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 6815779 4805.10 MB/sec warmup 77 sec latency 2.677 ms 2026-02-20T02:41:14.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 18271 15.14 MB/sec warmup 77 sec latency 48.187 ms 2026-02-20T02:41:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:14 trial098 ceph-mon[38923]: pgmap v518: 129 pgs: 129 active+clean; 417 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 255 op/s 2026-02-20T02:41:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:14 trial106 ceph-mon[44052]: pgmap v518: 129 pgs: 129 active+clean; 417 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 255 op/s 2026-02-20T02:41:15.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 6867175 4779.38 MB/sec warmup 78 sec latency 89.764 ms 2026-02-20T02:41:15.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 18425 14.97 MB/sec warmup 78 sec latency 112.790 ms 2026-02-20T02:41:16.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 6886290 4733.51 MB/sec warmup 79 sec latency 112.704 ms 2026-02-20T02:41:16.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 18564 14.82 MB/sec warmup 79 sec latency 144.444 ms 2026-02-20T02:41:17.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:16 trial098 ceph-mon[38923]: pgmap v519: 129 pgs: 129 active+clean; 420 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 242 op/s 2026-02-20T02:41:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:16 trial106 ceph-mon[44052]: pgmap v519: 129 pgs: 129 active+clean; 420 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 242 op/s 2026-02-20T02:41:17.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 6980619 4738.06 MB/sec warmup 80 sec latency 2.599 ms 2026-02-20T02:41:17.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 18803 14.76 MB/sec warmup 80 sec latency 55.120 ms 2026-02-20T02:41:18.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7072036 4740.52 MB/sec warmup 81 sec latency 25.221 ms 2026-02-20T02:41:18.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 19080 14.87 MB/sec warmup 81 sec latency 64.642 ms 2026-02-20T02:41:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:18 trial098 ceph-mon[38923]: pgmap v520: 129 pgs: 129 active+clean; 424 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.3 MiB/s wr, 230 op/s 2026-02-20T02:41:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:41:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:18 trial106 ceph-mon[44052]: pgmap v520: 129 pgs: 129 active+clean; 424 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.3 MiB/s wr, 230 op/s 2026-02-20T02:41:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:41:19.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7166519 4744.85 MB/sec warmup 82 sec latency 1.835 ms 2026-02-20T02:41:19.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 19321 14.85 MB/sec warmup 82 sec latency 43.716 ms 2026-02-20T02:41:20.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7260854 4748.91 MB/sec warmup 83 sec latency 2.792 ms 2026-02-20T02:41:20.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 19556 14.69 MB/sec warmup 83 sec latency 63.447 ms 2026-02-20T02:41:20.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:20 trial098 ceph-mon[38923]: pgmap v521: 129 pgs: 129 active+clean; 419 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 232 op/s 2026-02-20T02:41:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:20 trial106 ceph-mon[44052]: pgmap v521: 129 pgs: 129 active+clean; 419 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 232 op/s 2026-02-20T02:41:21.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7353553 4753.67 MB/sec warmup 84 sec latency 2.542 ms 2026-02-20T02:41:21.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 19799 14.55 MB/sec warmup 84 sec latency 43.222 ms 2026-02-20T02:41:22.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7448510 4758.18 MB/sec warmup 85 sec latency 2.888 ms 2026-02-20T02:41:22.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 20073 14.49 MB/sec warmup 85 sec latency 39.024 ms 2026-02-20T02:41:23.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:22 trial098 ceph-mon[38923]: pgmap v522: 129 pgs: 129 active+clean; 407 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.4 MiB/s wr, 240 op/s 2026-02-20T02:41:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:22 trial106 ceph-mon[44052]: pgmap v522: 129 pgs: 129 active+clean; 407 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.4 MiB/s wr, 240 op/s 2026-02-20T02:41:23.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7543736 4762.54 MB/sec warmup 86 sec latency 1.995 ms 2026-02-20T02:41:23.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 20304 14.48 MB/sec warmup 86 sec latency 48.027 ms 2026-02-20T02:41:24.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7638518 4766.51 MB/sec warmup 87 sec latency 2.219 ms 2026-02-20T02:41:24.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 20669 14.69 MB/sec warmup 87 sec latency 43.413 ms 2026-02-20T02:41:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:24 trial098 ceph-mon[38923]: pgmap v523: 129 pgs: 129 active+clean; 397 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.3 MiB/s wr, 217 op/s 2026-02-20T02:41:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:24 trial106 ceph-mon[44052]: pgmap v523: 129 pgs: 129 active+clean; 397 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.3 MiB/s wr, 217 op/s 2026-02-20T02:41:25.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7733104 4770.28 MB/sec warmup 88 sec latency 2.891 ms 2026-02-20T02:41:25.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 21060 14.86 MB/sec warmup 88 sec latency 37.373 ms 2026-02-20T02:41:26.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7826120 4774.93 MB/sec warmup 89 sec latency 10.911 ms 2026-02-20T02:41:26.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 21178 14.83 MB/sec warmup 89 sec latency 46.549 ms 2026-02-20T02:41:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:26 trial098 ceph-mon[38923]: pgmap v524: 129 pgs: 129 active+clean; 397 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 255 op/s 2026-02-20T02:41:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:26 trial106 ceph-mon[44052]: pgmap v524: 129 pgs: 129 active+clean; 397 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 255 op/s 2026-02-20T02:41:27.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 7921056 4778.75 MB/sec warmup 90 sec latency 1.759 ms 2026-02-20T02:41:27.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 21444 14.95 MB/sec warmup 90 sec latency 58.931 ms 2026-02-20T02:41:28.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 8015291 4782.07 MB/sec warmup 91 sec latency 11.547 ms 2026-02-20T02:41:28.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 21638 14.89 MB/sec warmup 91 sec latency 62.459 ms 2026-02-20T02:41:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:28 trial098 ceph-mon[38923]: pgmap v525: 129 pgs: 129 active+clean; 406 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 5.5 MiB/s wr, 259 op/s 2026-02-20T02:41:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:28 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:41:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:28 trial106 ceph-mon[44052]: pgmap v525: 129 pgs: 129 active+clean; 406 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 5.5 MiB/s wr, 259 op/s 2026-02-20T02:41:29.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:28 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:41:29.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 8110202 4785.71 MB/sec warmup 92 sec latency 11.517 ms 2026-02-20T02:41:29.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 21782 14.75 MB/sec warmup 92 sec latency 51.286 ms 2026-02-20T02:41:30.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:41:30.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:41:30.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:41:30.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:41:30.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:41:30.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:41:30.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 8205772 4789.78 MB/sec warmup 93 sec latency 2.572 ms 2026-02-20T02:41:30.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 21955 14.61 MB/sec warmup 93 sec latency 62.576 ms 2026-02-20T02:41:31.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:30 trial098 ceph-mon[38923]: pgmap v526: 129 pgs: 129 active+clean; 417 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.8 MiB/s wr, 254 op/s 2026-02-20T02:41:31.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:30 trial106 ceph-mon[44052]: pgmap v526: 129 pgs: 129 active+clean; 417 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.8 MiB/s wr, 254 op/s 2026-02-20T02:41:31.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 8297216 4793.01 MB/sec warmup 94 sec latency 31.711 ms 2026-02-20T02:41:31.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 22200 14.53 MB/sec warmup 94 sec latency 59.192 ms 2026-02-20T02:41:32.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 8336832 4765.00 MB/sec warmup 95 sec latency 84.725 ms 2026-02-20T02:41:32.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 22364 14.45 MB/sec warmup 95 sec latency 136.575 ms 2026-02-20T02:41:33.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:32 trial098 ceph-mon[38923]: pgmap v527: 129 pgs: 129 active+clean; 421 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.1 MiB/s wr, 239 op/s 2026-02-20T02:41:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:32 trial106 ceph-mon[44052]: pgmap v527: 129 pgs: 129 active+clean; 421 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.1 MiB/s wr, 239 op/s 2026-02-20T02:41:33.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 8362369 4729.76 MB/sec warmup 96 sec latency 97.838 ms 2026-02-20T02:41:33.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 22508 14.41 MB/sec warmup 96 sec latency 142.531 ms 2026-02-20T02:41:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:41:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:41:34.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 8457376 4733.68 MB/sec warmup 97 sec latency 68.272 ms 2026-02-20T02:41:34.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 22761 14.43 MB/sec warmup 97 sec latency 52.429 ms 2026-02-20T02:41:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:34 trial098 ceph-mon[38923]: pgmap v528: 129 pgs: 129 active+clean; 414 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.4 MiB/s wr, 233 op/s 2026-02-20T02:41:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:34 trial106 ceph-mon[44052]: pgmap v528: 129 pgs: 129 active+clean; 414 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.4 MiB/s wr, 233 op/s 2026-02-20T02:41:35.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 8552785 4737.93 MB/sec warmup 98 sec latency 2.115 ms 2026-02-20T02:41:35.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 23006 14.39 MB/sec warmup 98 sec latency 40.450 ms 2026-02-20T02:41:36.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 8647614 4741.69 MB/sec warmup 99 sec latency 3.003 ms 2026-02-20T02:41:36.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 23257 14.27 MB/sec warmup 99 sec latency 46.439 ms 2026-02-20T02:41:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:36 trial106 ceph-mon[44052]: pgmap v529: 129 pgs: 129 active+clean; 407 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 243 op/s 2026-02-20T02:41:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:36 trial098 ceph-mon[38923]: pgmap v529: 129 pgs: 129 active+clean; 407 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 243 op/s 2026-02-20T02:41:37.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 8740655 4746.14 MB/sec warmup 100 sec latency 1.955 ms 2026-02-20T02:41:37.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 23511 14.18 MB/sec warmup 100 sec latency 41.681 ms 2026-02-20T02:41:38.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 8835036 4749.51 MB/sec warmup 101 sec latency 2.507 ms 2026-02-20T02:41:38.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 23755 14.16 MB/sec warmup 101 sec latency 38.820 ms 2026-02-20T02:41:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:38 trial098 ceph-mon[38923]: pgmap v530: 129 pgs: 129 active+clean; 399 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.7 MiB/s wr, 222 op/s 2026-02-20T02:41:39.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:38 trial106 ceph-mon[44052]: pgmap v530: 129 pgs: 129 active+clean; 399 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.7 MiB/s wr, 222 op/s 2026-02-20T02:41:39.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 8882176 4727.96 MB/sec warmup 102 sec latency 126.808 ms 2026-02-20T02:41:39.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 23948 14.17 MB/sec warmup 102 sec latency 131.095 ms 2026-02-20T02:41:40.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 8977389 4731.85 MB/sec warmup 103 sec latency 2.139 ms 2026-02-20T02:41:40.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 24349 14.41 MB/sec warmup 103 sec latency 44.347 ms 2026-02-20T02:41:41.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:40 trial098 ceph-mon[38923]: pgmap v531: 129 pgs: 129 active+clean; 405 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 265 op/s 2026-02-20T02:41:41.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:40 trial106 ceph-mon[44052]: pgmap v531: 129 pgs: 129 active+clean; 405 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 265 op/s 2026-02-20T02:41:41.501 INFO:tasks.workunit.client.0.trial098.stdout: 10 9068951 4733.76 MB/sec warmup 104 sec latency 26.058 ms 2026-02-20T02:41:41.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 24631 14.44 MB/sec warmup 104 sec latency 46.540 ms 2026-02-20T02:41:42.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9163144 4737.42 MB/sec warmup 105 sec latency 3.279 ms 2026-02-20T02:41:42.506 INFO:tasks.workunit.client.1.trial106.stdout: 10 24816 14.46 MB/sec warmup 105 sec latency 38.665 ms 2026-02-20T02:41:43.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:42 trial098 ceph-mon[38923]: pgmap v532: 129 pgs: 129 active+clean; 412 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s rd, 4.6 MiB/s wr, 228 op/s 2026-02-20T02:41:43.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:42 trial106 ceph-mon[44052]: pgmap v532: 129 pgs: 129 active+clean; 412 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s rd, 4.6 MiB/s wr, 228 op/s 2026-02-20T02:41:43.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9256293 4741.33 MB/sec warmup 106 sec latency 13.953 ms 2026-02-20T02:41:43.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 25070 14.54 MB/sec warmup 106 sec latency 76.690 ms 2026-02-20T02:41:44.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9324305 4731.34 MB/sec warmup 107 sec latency 89.093 ms 2026-02-20T02:41:44.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 25215 14.46 MB/sec warmup 107 sec latency 97.646 ms 2026-02-20T02:41:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:44 trial098 ceph-mon[38923]: pgmap v533: 129 pgs: 129 active+clean; 422 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s rd, 5.2 MiB/s wr, 221 op/s 2026-02-20T02:41:45.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:44 trial106 ceph-mon[44052]: pgmap v533: 129 pgs: 129 active+clean; 422 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s rd, 5.2 MiB/s wr, 221 op/s 2026-02-20T02:41:45.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9402050 4726.35 MB/sec warmup 108 sec latency 58.035 ms 2026-02-20T02:41:45.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 25347 14.34 MB/sec warmup 108 sec latency 146.890 ms 2026-02-20T02:41:46.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9496341 4729.58 MB/sec warmup 109 sec latency 11.814 ms 2026-02-20T02:41:46.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 25536 14.23 MB/sec warmup 109 sec latency 51.796 ms 2026-02-20T02:41:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:46 trial106 ceph-mon[44052]: pgmap v534: 129 pgs: 129 active+clean; 430 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 244 op/s 2026-02-20T02:41:47.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:46 trial098 ceph-mon[38923]: pgmap v534: 129 pgs: 129 active+clean; 430 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 244 op/s 2026-02-20T02:41:47.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9591747 4733.48 MB/sec warmup 110 sec latency 2.124 ms 2026-02-20T02:41:47.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 25783 14.17 MB/sec warmup 110 sec latency 53.665 ms 2026-02-20T02:41:48.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9684303 4737.20 MB/sec warmup 111 sec latency 3.982 ms 2026-02-20T02:41:48.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 26026 14.13 MB/sec warmup 111 sec latency 55.294 ms 2026-02-20T02:41:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:48 trial098 ceph-mon[38923]: pgmap v535: 129 pgs: 129 active+clean; 438 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 6.3 MiB/s wr, 257 op/s 2026-02-20T02:41:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:41:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:48 trial106 ceph-mon[44052]: pgmap v535: 129 pgs: 129 active+clean; 438 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 6.3 MiB/s wr, 257 op/s 2026-02-20T02:41:49.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:41:49.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9780340 4741.11 MB/sec warmup 112 sec latency 2.579 ms 2026-02-20T02:41:49.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 26295 14.20 MB/sec warmup 112 sec latency 39.376 ms 2026-02-20T02:41:50.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9835019 4725.24 MB/sec warmup 113 sec latency 85.991 ms 2026-02-20T02:41:50.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 26500 14.16 MB/sec warmup 113 sec latency 104.459 ms 2026-02-20T02:41:51.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:50 trial098 ceph-mon[38923]: pgmap v536: 129 pgs: 129 active+clean; 428 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 243 op/s 2026-02-20T02:41:51.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:50 trial106 ceph-mon[44052]: pgmap v536: 129 pgs: 129 active+clean; 428 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 243 op/s 2026-02-20T02:41:51.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 9929265 4728.39 MB/sec warmup 114 sec latency 16.574 ms 2026-02-20T02:41:51.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 26740 14.06 MB/sec warmup 114 sec latency 39.585 ms 2026-02-20T02:41:52.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10026511 4733.04 MB/sec warmup 115 sec latency 2.024 ms 2026-02-20T02:41:52.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 26986 13.99 MB/sec warmup 115 sec latency 43.034 ms 2026-02-20T02:41:53.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:52 trial098 ceph-mon[38923]: pgmap v537: 129 pgs: 129 active+clean; 419 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.2 MiB/s wr, 223 op/s 2026-02-20T02:41:53.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:52 trial106 ceph-mon[44052]: pgmap v537: 129 pgs: 129 active+clean; 419 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.2 MiB/s wr, 223 op/s 2026-02-20T02:41:53.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10121661 4737.67 MB/sec warmup 116 sec latency 2.589 ms 2026-02-20T02:41:53.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 27224 13.94 MB/sec warmup 116 sec latency 43.949 ms 2026-02-20T02:41:54.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10217616 4741.42 MB/sec warmup 117 sec latency 2.355 ms 2026-02-20T02:41:54.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 27476 13.99 MB/sec warmup 117 sec latency 68.068 ms 2026-02-20T02:41:55.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:54 trial098 ceph-mon[38923]: pgmap v538: 129 pgs: 129 active+clean; 416 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.9 MiB/s wr, 252 op/s 2026-02-20T02:41:55.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:54 trial106 ceph-mon[44052]: pgmap v538: 129 pgs: 129 active+clean; 416 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.9 MiB/s wr, 252 op/s 2026-02-20T02:41:55.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10310569 4743.79 MB/sec warmup 118 sec latency 21.274 ms 2026-02-20T02:41:55.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 27870 14.19 MB/sec warmup 118 sec latency 45.880 ms 2026-02-20T02:41:56.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10370006 4730.78 MB/sec warmup 119 sec latency 89.616 ms 2026-02-20T02:41:56.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 28137 14.19 MB/sec warmup 119 sec latency 107.166 ms 2026-02-20T02:41:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:56 trial106 ceph-mon[44052]: pgmap v539: 129 pgs: 129 active+clean; 401 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 283 op/s 2026-02-20T02:41:57.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:56 trial098 ceph-mon[38923]: pgmap v539: 129 pgs: 129 active+clean; 401 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 283 op/s 2026-02-20T02:41:58.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10558982 5230.96 MB/sec execute 1 sec latency 11.830 ms 2026-02-20T02:41:58.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 28537 24.26 MB/sec execute 1 sec latency 64.119 ms 2026-02-20T02:41:59.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:41:58 trial098 ceph-mon[38923]: pgmap v540: 129 pgs: 129 active+clean; 406 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.1 MiB/s wr, 254 op/s 2026-02-20T02:41:59.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:41:58 trial106 ceph-mon[44052]: pgmap v540: 129 pgs: 129 active+clean; 406 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.1 MiB/s wr, 254 op/s 2026-02-20T02:41:59.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10652788 5150.37 MB/sec execute 2 sec latency 15.458 ms 2026-02-20T02:41:59.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 28738 17.86 MB/sec execute 2 sec latency 44.570 ms 2026-02-20T02:42:00.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10748827 5159.67 MB/sec execute 3 sec latency 2.303 ms 2026-02-20T02:42:00.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 28891 12.48 MB/sec execute 3 sec latency 48.179 ms 2026-02-20T02:42:01.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:00 trial098 ceph-mon[38923]: pgmap v541: 129 pgs: 129 active+clean; 417 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 240 op/s 2026-02-20T02:42:01.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:00 trial106 ceph-mon[44052]: pgmap v541: 129 pgs: 129 active+clean; 417 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 240 op/s 2026-02-20T02:42:01.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10842985 5141.01 MB/sec execute 4 sec latency 5.287 ms 2026-02-20T02:42:01.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 29082 9.88 MB/sec execute 4 sec latency 49.906 ms 2026-02-20T02:42:02.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 10936136 5117.29 MB/sec execute 5 sec latency 13.901 ms 2026-02-20T02:42:02.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 29330 9.43 MB/sec execute 5 sec latency 52.291 ms 2026-02-20T02:42:03.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:02 trial098 ceph-mon[38923]: pgmap v542: 129 pgs: 129 active+clean; 421 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 5.9 MiB/s wr, 233 op/s 2026-02-20T02:42:03.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:02 trial106 ceph-mon[44052]: pgmap v542: 129 pgs: 129 active+clean; 421 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 5.9 MiB/s wr, 233 op/s 2026-02-20T02:42:03.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 11029230 5128.55 MB/sec execute 6 sec latency 2.486 ms 2026-02-20T02:42:03.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 29575 9.76 MB/sec execute 6 sec latency 52.678 ms 2026-02-20T02:42:04.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:42:04.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:42:04.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 11121783 5107.67 MB/sec execute 7 sec latency 9.615 ms 2026-02-20T02:42:04.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 29840 11.36 MB/sec execute 7 sec latency 47.770 ms 2026-02-20T02:42:05.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:04 trial098 ceph-mon[38923]: pgmap v543: 129 pgs: 129 active+clean; 422 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 6.3 MiB/s wr, 224 op/s 2026-02-20T02:42:05.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:04 trial106 ceph-mon[44052]: pgmap v543: 129 pgs: 129 active+clean; 422 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 6.3 MiB/s wr, 224 op/s 2026-02-20T02:42:05.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 11217005 5111.62 MB/sec execute 8 sec latency 8.586 ms 2026-02-20T02:42:05.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 30091 11.23 MB/sec execute 8 sec latency 42.959 ms 2026-02-20T02:42:06.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 11306786 5082.23 MB/sec execute 9 sec latency 52.956 ms 2026-02-20T02:42:06.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 30330 10.24 MB/sec execute 9 sec latency 69.228 ms 2026-02-20T02:42:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:06 trial106 ceph-mon[44052]: pgmap v544: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 246 op/s 2026-02-20T02:42:07.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:06 trial098 ceph-mon[38923]: pgmap v544: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 246 op/s 2026-02-20T02:42:07.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 11400722 5080.93 MB/sec execute 10 sec latency 30.592 ms 2026-02-20T02:42:07.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 30577 9.77 MB/sec execute 10 sec latency 46.519 ms 2026-02-20T02:42:08.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 11494867 5094.75 MB/sec execute 11 sec latency 2.155 ms 2026-02-20T02:42:08.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 30824 9.80 MB/sec execute 11 sec latency 38.597 ms 2026-02-20T02:42:09.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:08 trial098 ceph-mon[38923]: pgmap v545: 129 pgs: 129 active+clean; 409 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 226 op/s 2026-02-20T02:42:09.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:08 trial106 ceph-mon[44052]: pgmap v545: 129 pgs: 129 active+clean; 409 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 226 op/s 2026-02-20T02:42:09.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 11590234 5098.14 MB/sec execute 12 sec latency 3.686 ms 2026-02-20T02:42:09.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 31119 11.28 MB/sec execute 12 sec latency 46.885 ms 2026-02-20T02:42:10.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 11685130 5100.58 MB/sec execute 13 sec latency 3.996 ms 2026-02-20T02:42:10.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 31514 13.00 MB/sec execute 13 sec latency 41.562 ms 2026-02-20T02:42:11.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:10 trial098 ceph-mon[38923]: pgmap v546: 129 pgs: 129 active+clean; 409 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 265 op/s 2026-02-20T02:42:11.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:10 trial106 ceph-mon[44052]: pgmap v546: 129 pgs: 129 active+clean; 409 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 265 op/s 2026-02-20T02:42:11.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 11764996 5043.57 MB/sec execute 14 sec latency 104.553 ms 2026-02-20T02:42:11.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 31735 12.97 MB/sec execute 14 sec latency 87.648 ms 2026-02-20T02:42:12.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 11766371 4712.21 MB/sec execute 15 sec latency 101.800 ms 2026-02-20T02:42:12.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 31800 12.59 MB/sec execute 15 sec latency 128.927 ms 2026-02-20T02:42:13.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:12 trial098 ceph-mon[38923]: pgmap v547: 129 pgs: 129 active+clean; 416 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.2 MiB/s wr, 249 op/s 2026-02-20T02:42:13.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:12 trial106 ceph-mon[44052]: pgmap v547: 129 pgs: 129 active+clean; 416 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.2 MiB/s wr, 249 op/s 2026-02-20T02:42:13.502 INFO:tasks.workunit.client.0.trial098.stdout: 10 11841648 4671.61 MB/sec execute 16 sec latency 101.024 ms 2026-02-20T02:42:13.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 31999 12.97 MB/sec execute 16 sec latency 105.488 ms 2026-02-20T02:42:14.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 11935522 4702.27 MB/sec execute 17 sec latency 14.552 ms 2026-02-20T02:42:14.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 32231 13.19 MB/sec execute 17 sec latency 58.300 ms 2026-02-20T02:42:15.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:14 trial098 ceph-mon[38923]: pgmap v548: 129 pgs: 129 active+clean; 431 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 275 op/s 2026-02-20T02:42:15.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:14 trial106 ceph-mon[44052]: pgmap v548: 129 pgs: 129 active+clean; 431 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 275 op/s 2026-02-20T02:42:15.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12030889 4728.05 MB/sec execute 18 sec latency 2.848 ms 2026-02-20T02:42:15.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 32387 12.66 MB/sec execute 18 sec latency 47.314 ms 2026-02-20T02:42:16.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12126088 4749.57 MB/sec execute 19 sec latency 2.122 ms 2026-02-20T02:42:16.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 32559 12.09 MB/sec execute 19 sec latency 52.688 ms 2026-02-20T02:42:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:16 trial106 ceph-mon[44052]: pgmap v549: 129 pgs: 129 active+clean; 433 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 254 op/s 2026-02-20T02:42:17.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:16 trial098 ceph-mon[38923]: pgmap v549: 129 pgs: 129 active+clean; 433 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 254 op/s 2026-02-20T02:42:17.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12218400 4761.23 MB/sec execute 20 sec latency 17.230 ms 2026-02-20T02:42:17.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 32792 11.74 MB/sec execute 20 sec latency 49.526 ms 2026-02-20T02:42:18.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12311916 4775.13 MB/sec execute 21 sec latency 2.536 ms 2026-02-20T02:42:18.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 33047 11.76 MB/sec execute 21 sec latency 45.434 ms 2026-02-20T02:42:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:18 trial098 ceph-mon[38923]: pgmap v550: 129 pgs: 129 active+clean; 440 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 5.9 MiB/s wr, 220 op/s 2026-02-20T02:42:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:42:19.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:18 trial106 ceph-mon[44052]: pgmap v550: 129 pgs: 129 active+clean; 440 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 5.9 MiB/s wr, 220 op/s 2026-02-20T02:42:19.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:42:19.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12404847 4792.56 MB/sec execute 22 sec latency 3.796 ms 2026-02-20T02:42:19.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 33300 12.02 MB/sec execute 22 sec latency 57.346 ms 2026-02-20T02:42:20.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12500350 4808.29 MB/sec execute 23 sec latency 2.383 ms 2026-02-20T02:42:20.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 33552 12.19 MB/sec execute 23 sec latency 42.156 ms 2026-02-20T02:42:21.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:20 trial098 ceph-mon[38923]: pgmap v551: 129 pgs: 129 active+clean; 438 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 211 op/s 2026-02-20T02:42:21.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:20 trial106 ceph-mon[44052]: pgmap v551: 129 pgs: 129 active+clean; 438 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 211 op/s 2026-02-20T02:42:21.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12595465 4821.51 MB/sec execute 24 sec latency 2.105 ms 2026-02-20T02:42:21.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 33796 11.77 MB/sec execute 24 sec latency 46.209 ms 2026-02-20T02:42:22.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12690954 4834.64 MB/sec execute 25 sec latency 19.190 ms 2026-02-20T02:42:22.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 34038 11.44 MB/sec execute 25 sec latency 46.825 ms 2026-02-20T02:42:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:22 trial098 ceph-mon[38923]: pgmap v552: 129 pgs: 129 active+clean; 433 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 6.2 MiB/s wr, 217 op/s 2026-02-20T02:42:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:22 trial106 ceph-mon[44052]: pgmap v552: 129 pgs: 129 active+clean; 433 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 6.2 MiB/s wr, 217 op/s 2026-02-20T02:42:23.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12786557 4847.51 MB/sec execute 26 sec latency 1.979 ms 2026-02-20T02:42:23.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 34291 11.37 MB/sec execute 26 sec latency 41.887 ms 2026-02-20T02:42:24.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12881705 4863.91 MB/sec execute 27 sec latency 2.219 ms 2026-02-20T02:42:24.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 34560 11.72 MB/sec execute 27 sec latency 43.245 ms 2026-02-20T02:42:25.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:24 trial098 ceph-mon[38923]: pgmap v553: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.8 MiB/s wr, 231 op/s 2026-02-20T02:42:25.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:24 trial106 ceph-mon[44052]: pgmap v553: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.8 MiB/s wr, 231 op/s 2026-02-20T02:42:25.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 12977511 4874.66 MB/sec execute 28 sec latency 2.424 ms 2026-02-20T02:42:25.507 INFO:tasks.workunit.client.1.trial106.stdout: 10 34923 12.41 MB/sec execute 28 sec latency 40.826 ms 2026-02-20T02:42:26.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13073101 4884.25 MB/sec execute 29 sec latency 2.998 ms 2026-02-20T02:42:26.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 35249 12.77 MB/sec execute 29 sec latency 41.535 ms 2026-02-20T02:42:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:26 trial106 ceph-mon[44052]: pgmap v554: 129 pgs: 129 active+clean; 416 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 267 op/s 2026-02-20T02:42:27.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:26 trial098 ceph-mon[38923]: pgmap v554: 129 pgs: 129 active+clean; 416 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 267 op/s 2026-02-20T02:42:27.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13168796 4893.41 MB/sec execute 30 sec latency 2.247 ms 2026-02-20T02:42:27.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 35399 12.78 MB/sec execute 30 sec latency 41.122 ms 2026-02-20T02:42:28.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13239205 4858.25 MB/sec execute 31 sec latency 82.398 ms 2026-02-20T02:42:28.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 35605 12.99 MB/sec execute 31 sec latency 111.920 ms 2026-02-20T02:42:29.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:28 trial098 ceph-mon[38923]: pgmap v555: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.5 MiB/s wr, 273 op/s 2026-02-20T02:42:29.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:28 trial106 ceph-mon[44052]: pgmap v555: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.5 MiB/s wr, 273 op/s 2026-02-20T02:42:29.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13240875 4709.25 MB/sec execute 32 sec latency 90.732 ms 2026-02-20T02:42:29.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 35710 12.88 MB/sec execute 32 sec latency 143.933 ms 2026-02-20T02:42:30.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:42:30.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:42:30.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:42:30.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:42:30.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:42:30.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:42:30.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:42:30.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:42:30.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13327359 4712.13 MB/sec execute 33 sec latency 52.986 ms 2026-02-20T02:42:30.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 35878 12.68 MB/sec execute 33 sec latency 104.999 ms 2026-02-20T02:42:31.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:30 trial098 ceph-mon[38923]: pgmap v556: 129 pgs: 129 active+clean; 421 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 251 op/s 2026-02-20T02:42:31.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:30 trial106 ceph-mon[44052]: pgmap v556: 129 pgs: 129 active+clean; 421 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 251 op/s 2026-02-20T02:42:31.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13422134 4724.33 MB/sec execute 34 sec latency 3.031 ms 2026-02-20T02:42:31.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 36040 12.36 MB/sec execute 34 sec latency 56.927 ms 2026-02-20T02:42:32.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13515340 4732.87 MB/sec execute 35 sec latency 20.315 ms 2026-02-20T02:42:32.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 36252 12.12 MB/sec execute 35 sec latency 49.839 ms 2026-02-20T02:42:33.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:32 trial098 ceph-mon[38923]: pgmap v557: 129 pgs: 129 active+clean; 428 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 6.3 MiB/s wr, 268 op/s 2026-02-20T02:42:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:32 trial106 ceph-mon[44052]: pgmap v557: 129 pgs: 129 active+clean; 428 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 6.3 MiB/s wr, 268 op/s 2026-02-20T02:42:33.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13609391 4742.35 MB/sec execute 36 sec latency 3.688 ms 2026-02-20T02:42:33.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 36501 12.03 MB/sec execute 36 sec latency 51.171 ms 2026-02-20T02:42:34.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:42:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:42:34.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13702951 4750.87 MB/sec execute 37 sec latency 2.774 ms 2026-02-20T02:42:34.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 36752 12.14 MB/sec execute 37 sec latency 52.743 ms 2026-02-20T02:42:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:34 trial098 ceph-mon[38923]: pgmap v558: 129 pgs: 129 active+clean; 431 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 6.3 MiB/s wr, 237 op/s 2026-02-20T02:42:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:34 trial106 ceph-mon[44052]: pgmap v558: 129 pgs: 129 active+clean; 431 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 6.3 MiB/s wr, 237 op/s 2026-02-20T02:42:35.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13754754 4701.22 MB/sec execute 38 sec latency 87.730 ms 2026-02-20T02:42:35.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 36948 12.23 MB/sec execute 38 sec latency 137.428 ms 2026-02-20T02:42:36.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:36 trial098 ceph-mon[38923]: pgmap v559: 129 pgs: 129 active+clean; 427 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 237 op/s 2026-02-20T02:42:36.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:36 trial106 ceph-mon[44052]: pgmap v559: 129 pgs: 129 active+clean; 427 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 237 op/s 2026-02-20T02:42:36.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 13849637 4714.07 MB/sec execute 39 sec latency 4.029 ms 2026-02-20T02:42:36.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 37188 12.11 MB/sec execute 39 sec latency 44.884 ms 2026-02-20T02:42:37.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 13938270 4715.51 MB/sec execute 40 sec latency 34.268 ms 2026-02-20T02:42:37.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 37423 11.87 MB/sec execute 40 sec latency 51.038 ms 2026-02-20T02:42:38.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14032983 4725.00 MB/sec execute 41 sec latency 3.591 ms 2026-02-20T02:42:38.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 37677 11.71 MB/sec execute 41 sec latency 50.048 ms 2026-02-20T02:42:39.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:38 trial098 ceph-mon[38923]: pgmap v560: 129 pgs: 129 active+clean; 417 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 5.9 MiB/s wr, 189 op/s 2026-02-20T02:42:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:38 trial106 ceph-mon[44052]: pgmap v560: 129 pgs: 129 active+clean; 417 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 5.9 MiB/s wr, 189 op/s 2026-02-20T02:42:39.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14126782 4733.36 MB/sec execute 42 sec latency 3.533 ms 2026-02-20T02:42:39.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 37919 11.74 MB/sec execute 42 sec latency 46.871 ms 2026-02-20T02:42:40.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14217674 4739.19 MB/sec execute 43 sec latency 33.216 ms 2026-02-20T02:42:40.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 38231 12.08 MB/sec execute 43 sec latency 44.874 ms 2026-02-20T02:42:41.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:40 trial098 ceph-mon[38923]: pgmap v561: 129 pgs: 129 active+clean; 414 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 246 op/s 2026-02-20T02:42:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:40 trial106 ceph-mon[44052]: pgmap v561: 129 pgs: 129 active+clean; 414 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 246 op/s 2026-02-20T02:42:41.503 INFO:tasks.workunit.client.0.trial098.stdout: 10 14264301 4690.10 MB/sec execute 44 sec latency 120.585 ms 2026-02-20T02:42:41.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 38477 12.26 MB/sec execute 44 sec latency 172.853 ms 2026-02-20T02:42:42.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14358437 4698.69 MB/sec execute 45 sec latency 1.926 ms 2026-02-20T02:42:42.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 38803 12.54 MB/sec execute 45 sec latency 40.894 ms 2026-02-20T02:42:43.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:42 trial098 ceph-mon[38923]: pgmap v562: 129 pgs: 129 active+clean; 418 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 4.8 MiB/s wr, 254 op/s 2026-02-20T02:42:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:42 trial106 ceph-mon[44052]: pgmap v562: 129 pgs: 129 active+clean; 418 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 4.8 MiB/s wr, 254 op/s 2026-02-20T02:42:43.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14451461 4705.67 MB/sec execute 46 sec latency 19.724 ms 2026-02-20T02:42:43.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 38976 12.63 MB/sec execute 46 sec latency 38.999 ms 2026-02-20T02:42:44.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14545862 4713.86 MB/sec execute 47 sec latency 2.884 ms 2026-02-20T02:42:44.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 39204 12.69 MB/sec execute 47 sec latency 62.412 ms 2026-02-20T02:42:45.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:44 trial098 ceph-mon[38923]: pgmap v563: 129 pgs: 129 active+clean; 431 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.2 MiB/s wr, 237 op/s 2026-02-20T02:42:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:44 trial106 ceph-mon[44052]: pgmap v563: 129 pgs: 129 active+clean; 431 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.2 MiB/s wr, 237 op/s 2026-02-20T02:42:45.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14639851 4721.51 MB/sec execute 48 sec latency 2.568 ms 2026-02-20T02:42:45.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 39407 12.69 MB/sec execute 48 sec latency 52.703 ms 2026-02-20T02:42:46.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14700545 4694.60 MB/sec execute 49 sec latency 131.491 ms 2026-02-20T02:42:46.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 39529 12.46 MB/sec execute 49 sec latency 156.214 ms 2026-02-20T02:42:47.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:46 trial098 ceph-mon[38923]: pgmap v564: 129 pgs: 129 active+clean; 442 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 266 op/s 2026-02-20T02:42:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:46 trial106 ceph-mon[44052]: pgmap v564: 129 pgs: 129 active+clean; 442 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 266 op/s 2026-02-20T02:42:47.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14771219 4677.34 MB/sec execute 50 sec latency 74.342 ms 2026-02-20T02:42:47.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 39686 12.25 MB/sec execute 50 sec latency 158.163 ms 2026-02-20T02:42:48.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14863756 4683.62 MB/sec execute 51 sec latency 27.070 ms 2026-02-20T02:42:48.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 39916 12.11 MB/sec execute 51 sec latency 50.438 ms 2026-02-20T02:42:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:48 trial098 ceph-mon[38923]: pgmap v565: 129 pgs: 129 active+clean; 443 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 5.9 MiB/s wr, 233 op/s 2026-02-20T02:42:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:42:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:48 trial106 ceph-mon[44052]: pgmap v565: 129 pgs: 129 active+clean; 443 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 5.9 MiB/s wr, 233 op/s 2026-02-20T02:42:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:42:49.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 14958453 4691.49 MB/sec execute 52 sec latency 3.214 ms 2026-02-20T02:42:49.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 40177 12.14 MB/sec execute 52 sec latency 49.142 ms 2026-02-20T02:42:50.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15053350 4699.81 MB/sec execute 53 sec latency 2.678 ms 2026-02-20T02:42:50.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 40440 12.27 MB/sec execute 53 sec latency 49.132 ms 2026-02-20T02:42:51.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:50 trial098 ceph-mon[38923]: pgmap v566: 129 pgs: 129 active+clean; 447 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 234 op/s 2026-02-20T02:42:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:50 trial106 ceph-mon[44052]: pgmap v566: 129 pgs: 129 active+clean; 447 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 234 op/s 2026-02-20T02:42:51.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15146744 4708.23 MB/sec execute 54 sec latency 2.450 ms 2026-02-20T02:42:51.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 40697 12.28 MB/sec execute 54 sec latency 43.611 ms 2026-02-20T02:42:52.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15190225 4665.90 MB/sec execute 55 sec latency 119.668 ms 2026-02-20T02:42:52.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 40864 12.09 MB/sec execute 55 sec latency 136.826 ms 2026-02-20T02:42:53.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:52 trial098 ceph-mon[38923]: pgmap v567: 129 pgs: 129 active+clean; 445 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.3 MiB/s wr, 213 op/s 2026-02-20T02:42:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:52 trial106 ceph-mon[44052]: pgmap v567: 129 pgs: 129 active+clean; 445 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.3 MiB/s wr, 213 op/s 2026-02-20T02:42:53.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15286349 4675.24 MB/sec execute 56 sec latency 3.356 ms 2026-02-20T02:42:53.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 41111 11.93 MB/sec execute 56 sec latency 44.044 ms 2026-02-20T02:42:54.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15382010 4683.59 MB/sec execute 57 sec latency 2.671 ms 2026-02-20T02:42:54.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 41363 11.88 MB/sec execute 57 sec latency 40.603 ms 2026-02-20T02:42:55.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:54 trial098 ceph-mon[38923]: pgmap v568: 129 pgs: 129 active+clean; 429 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.2 MiB/s wr, 224 op/s 2026-02-20T02:42:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:54 trial106 ceph-mon[44052]: pgmap v568: 129 pgs: 129 active+clean; 429 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.2 MiB/s wr, 224 op/s 2026-02-20T02:42:55.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15474467 4688.70 MB/sec execute 58 sec latency 17.444 ms 2026-02-20T02:42:55.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 41628 12.03 MB/sec execute 58 sec latency 48.726 ms 2026-02-20T02:42:56.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15568253 4695.27 MB/sec execute 59 sec latency 17.444 ms 2026-02-20T02:42:56.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 41991 12.33 MB/sec execute 59 sec latency 45.975 ms 2026-02-20T02:42:57.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:56 trial098 ceph-mon[38923]: pgmap v569: 129 pgs: 129 active+clean; 414 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 273 op/s 2026-02-20T02:42:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:56 trial106 ceph-mon[44052]: pgmap v569: 129 pgs: 129 active+clean; 414 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 273 op/s 2026-02-20T02:42:57.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15652446 4695.18 MB/sec execute 60 sec latency 67.693 ms 2026-02-20T02:42:57.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 42293 12.52 MB/sec execute 60 sec latency 90.044 ms 2026-02-20T02:42:58.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15699949 4660.20 MB/sec execute 61 sec latency 119.005 ms 2026-02-20T02:42:58.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 42416 12.44 MB/sec execute 61 sec latency 165.324 ms 2026-02-20T02:42:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:42:58 trial098 ceph-mon[38923]: pgmap v570: 129 pgs: 129 active+clean; 419 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.0 MiB/s wr, 229 op/s 2026-02-20T02:42:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:42:58 trial106 ceph-mon[44052]: pgmap v570: 129 pgs: 129 active+clean; 419 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.0 MiB/s wr, 229 op/s 2026-02-20T02:42:59.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15794462 4667.29 MB/sec execute 62 sec latency 2.621 ms 2026-02-20T02:42:59.508 INFO:tasks.workunit.client.1.trial106.stdout: 10 42637 12.60 MB/sec execute 62 sec latency 50.772 ms 2026-02-20T02:43:00.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15890230 4675.22 MB/sec execute 63 sec latency 2.676 ms 2026-02-20T02:43:00.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 42857 12.66 MB/sec execute 63 sec latency 73.774 ms 2026-02-20T02:43:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:00 trial098 ceph-mon[38923]: pgmap v571: 129 pgs: 129 active+clean; 429 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 261 op/s 2026-02-20T02:43:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:00 trial106 ceph-mon[44052]: pgmap v571: 129 pgs: 129 active+clean; 429 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 261 op/s 2026-02-20T02:43:01.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 15983725 4681.00 MB/sec execute 64 sec latency 3.402 ms 2026-02-20T02:43:01.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 43023 12.53 MB/sec execute 64 sec latency 49.889 ms 2026-02-20T02:43:02.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 16079156 4690.35 MB/sec execute 65 sec latency 2.267 ms 2026-02-20T02:43:02.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 43196 12.36 MB/sec execute 65 sec latency 53.725 ms 2026-02-20T02:43:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:02 trial098 ceph-mon[38923]: pgmap v572: 129 pgs: 129 active+clean; 438 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 280 op/s 2026-02-20T02:43:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:02 trial106 ceph-mon[44052]: pgmap v572: 129 pgs: 129 active+clean; 438 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 280 op/s 2026-02-20T02:43:03.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 16132087 4662.73 MB/sec execute 66 sec latency 68.244 ms 2026-02-20T02:43:03.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 43361 12.23 MB/sec execute 66 sec latency 159.855 ms 2026-02-20T02:43:04.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:43:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:43:04.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 16223163 4666.56 MB/sec execute 67 sec latency 39.813 ms 2026-02-20T02:43:04.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 43614 12.21 MB/sec execute 67 sec latency 77.182 ms 2026-02-20T02:43:05.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:04 trial098 ceph-mon[38923]: pgmap v573: 129 pgs: 129 active+clean; 442 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 254 op/s 2026-02-20T02:43:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:04 trial106 ceph-mon[44052]: pgmap v573: 129 pgs: 129 active+clean; 442 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 254 op/s 2026-02-20T02:43:05.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 16317638 4672.74 MB/sec execute 68 sec latency 2.548 ms 2026-02-20T02:43:05.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 43860 12.22 MB/sec execute 68 sec latency 46.977 ms 2026-02-20T02:43:06.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 16411934 4678.97 MB/sec execute 69 sec latency 2.202 ms 2026-02-20T02:43:06.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 44121 12.29 MB/sec execute 69 sec latency 40.994 ms 2026-02-20T02:43:07.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:06 trial098 ceph-mon[38923]: pgmap v574: 129 pgs: 129 active+clean; 435 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 239 op/s 2026-02-20T02:43:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:06 trial106 ceph-mon[44052]: pgmap v574: 129 pgs: 129 active+clean; 435 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 239 op/s 2026-02-20T02:43:07.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 16506343 4685.78 MB/sec execute 70 sec latency 3.369 ms 2026-02-20T02:43:07.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 44368 12.22 MB/sec execute 70 sec latency 48.612 ms 2026-02-20T02:43:08.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 16600518 4692.55 MB/sec execute 71 sec latency 13.830 ms 2026-02-20T02:43:08.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 44622 12.10 MB/sec execute 71 sec latency 39.206 ms 2026-02-20T02:43:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:08 trial098 ceph-mon[38923]: pgmap v575: 129 pgs: 129 active+clean; 425 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 213 op/s 2026-02-20T02:43:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:08 trial106 ceph-mon[44052]: pgmap v575: 129 pgs: 129 active+clean; 425 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 213 op/s 2026-02-20T02:43:09.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 16657439 4669.96 MB/sec execute 72 sec latency 105.143 ms 2026-02-20T02:43:09.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 44835 12.03 MB/sec execute 72 sec latency 126.774 ms 2026-02-20T02:43:10.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 16751247 4675.19 MB/sec execute 73 sec latency 18.174 ms 2026-02-20T02:43:10.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 45096 12.07 MB/sec execute 73 sec latency 49.752 ms 2026-02-20T02:43:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:10 trial098 ceph-mon[38923]: pgmap v576: 129 pgs: 129 active+clean; 421 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.8 MiB/s wr, 264 op/s 2026-02-20T02:43:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:10 trial106 ceph-mon[44052]: pgmap v576: 129 pgs: 129 active+clean; 421 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.8 MiB/s wr, 264 op/s 2026-02-20T02:43:11.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 16846925 4681.98 MB/sec execute 74 sec latency 2.423 ms 2026-02-20T02:43:11.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 45401 12.25 MB/sec execute 74 sec latency 43.561 ms 2026-02-20T02:43:12.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 16942606 4688.41 MB/sec execute 75 sec latency 1.948 ms 2026-02-20T02:43:12.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 45792 12.52 MB/sec execute 75 sec latency 43.145 ms 2026-02-20T02:43:13.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:12 trial098 ceph-mon[38923]: pgmap v577: 129 pgs: 129 active+clean; 422 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.2 MiB/s wr, 260 op/s 2026-02-20T02:43:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:12 trial106 ceph-mon[44052]: pgmap v577: 129 pgs: 129 active+clean; 422 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.2 MiB/s wr, 260 op/s 2026-02-20T02:43:13.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17033572 4693.21 MB/sec execute 76 sec latency 29.571 ms 2026-02-20T02:43:13.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 45988 12.55 MB/sec execute 76 sec latency 60.934 ms 2026-02-20T02:43:14.504 INFO:tasks.workunit.client.0.trial098.stdout: 10 17128506 4698.67 MB/sec execute 77 sec latency 5.689 ms 2026-02-20T02:43:14.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 46208 12.67 MB/sec execute 77 sec latency 60.349 ms 2026-02-20T02:43:15.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:14 trial098 ceph-mon[38923]: pgmap v578: 129 pgs: 129 active+clean; 431 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.1 MiB/s wr, 238 op/s 2026-02-20T02:43:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:14 trial106 ceph-mon[44052]: pgmap v578: 129 pgs: 129 active+clean; 431 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.1 MiB/s wr, 238 op/s 2026-02-20T02:43:15.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17223831 4704.41 MB/sec execute 78 sec latency 2.692 ms 2026-02-20T02:43:15.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 46428 12.68 MB/sec execute 78 sec latency 56.756 ms 2026-02-20T02:43:16.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17320308 4710.86 MB/sec execute 79 sec latency 2.128 ms 2026-02-20T02:43:16.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 46595 12.57 MB/sec execute 79 sec latency 50.443 ms 2026-02-20T02:43:17.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:16 trial098 ceph-mon[38923]: pgmap v579: 129 pgs: 129 active+clean; 443 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.6 MiB/s wr, 255 op/s 2026-02-20T02:43:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:16 trial106 ceph-mon[44052]: pgmap v579: 129 pgs: 129 active+clean; 443 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.6 MiB/s wr, 255 op/s 2026-02-20T02:43:17.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17415442 4716.81 MB/sec execute 80 sec latency 2.623 ms 2026-02-20T02:43:17.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 46777 12.45 MB/sec execute 80 sec latency 49.761 ms 2026-02-20T02:43:18.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17509150 4722.16 MB/sec execute 81 sec latency 2.839 ms 2026-02-20T02:43:18.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 47002 12.35 MB/sec execute 81 sec latency 49.627 ms 2026-02-20T02:43:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:18 trial098 ceph-mon[38923]: pgmap v580: 129 pgs: 129 active+clean; 449 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 255 op/s 2026-02-20T02:43:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:43:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:18 trial106 ceph-mon[44052]: pgmap v580: 129 pgs: 129 active+clean; 449 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 255 op/s 2026-02-20T02:43:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:43:19.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17597628 4722.73 MB/sec execute 82 sec latency 60.465 ms 2026-02-20T02:43:19.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 47248 12.33 MB/sec execute 82 sec latency 60.662 ms 2026-02-20T02:43:20.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17688676 4725.01 MB/sec execute 83 sec latency 76.233 ms 2026-02-20T02:43:20.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 47503 12.40 MB/sec execute 83 sec latency 63.372 ms 2026-02-20T02:43:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:20 trial098 ceph-mon[38923]: pgmap v581: 129 pgs: 129 active+clean; 454 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 6.5 MiB/s wr, 254 op/s 2026-02-20T02:43:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:20 trial106 ceph-mon[44052]: pgmap v581: 129 pgs: 129 active+clean; 454 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 6.5 MiB/s wr, 254 op/s 2026-02-20T02:43:21.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17784340 4730.25 MB/sec execute 84 sec latency 2.461 ms 2026-02-20T02:43:21.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 47769 12.45 MB/sec execute 84 sec latency 43.918 ms 2026-02-20T02:43:22.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17879457 4735.72 MB/sec execute 85 sec latency 1.867 ms 2026-02-20T02:43:22.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 48014 12.34 MB/sec execute 85 sec latency 41.192 ms 2026-02-20T02:43:23.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:22 trial098 ceph-mon[38923]: pgmap v582: 129 pgs: 129 active+clean; 448 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 229 op/s 2026-02-20T02:43:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:22 trial106 ceph-mon[44052]: pgmap v582: 129 pgs: 129 active+clean; 448 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 229 op/s 2026-02-20T02:43:23.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 17974236 4741.11 MB/sec execute 86 sec latency 2.879 ms 2026-02-20T02:43:23.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 48261 12.25 MB/sec execute 86 sec latency 45.223 ms 2026-02-20T02:43:24.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18067175 4744.17 MB/sec execute 87 sec latency 21.160 ms 2026-02-20T02:43:24.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 48517 12.25 MB/sec execute 87 sec latency 39.454 ms 2026-02-20T02:43:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:24 trial098 ceph-mon[38923]: pgmap v583: 129 pgs: 129 active+clean; 432 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 260 op/s 2026-02-20T02:43:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:24 trial106 ceph-mon[44052]: pgmap v583: 129 pgs: 129 active+clean; 432 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 260 op/s 2026-02-20T02:43:25.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18074112 4694.55 MB/sec execute 88 sec latency 96.662 ms 2026-02-20T02:43:25.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 48631 12.17 MB/sec execute 88 sec latency 150.215 ms 2026-02-20T02:43:26.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18143247 4683.63 MB/sec execute 89 sec latency 64.172 ms 2026-02-20T02:43:26.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 48893 12.28 MB/sec execute 89 sec latency 118.586 ms 2026-02-20T02:43:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:26 trial098 ceph-mon[38923]: pgmap v584: 129 pgs: 129 active+clean; 411 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 262 op/s 2026-02-20T02:43:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:26 trial106 ceph-mon[44052]: pgmap v584: 129 pgs: 129 active+clean; 411 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 262 op/s 2026-02-20T02:43:27.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18238277 4688.62 MB/sec execute 90 sec latency 2.183 ms 2026-02-20T02:43:27.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 49245 12.50 MB/sec execute 90 sec latency 42.813 ms 2026-02-20T02:43:28.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18332901 4693.91 MB/sec execute 91 sec latency 3.113 ms 2026-02-20T02:43:28.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 49511 12.55 MB/sec execute 91 sec latency 46.933 ms 2026-02-20T02:43:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:28 trial098 ceph-mon[38923]: pgmap v585: 129 pgs: 129 active+clean; 419 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 263 op/s 2026-02-20T02:43:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:28 trial106 ceph-mon[44052]: pgmap v585: 129 pgs: 129 active+clean; 419 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 263 op/s 2026-02-20T02:43:29.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18424954 4697.80 MB/sec execute 92 sec latency 26.509 ms 2026-02-20T02:43:29.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 49699 12.59 MB/sec execute 92 sec latency 64.229 ms 2026-02-20T02:43:30.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:43:30.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:43:30.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:43:30.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:43:30.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:43:30.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:43:30.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:43:30.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:43:30.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18517204 4700.77 MB/sec execute 93 sec latency 6.286 ms 2026-02-20T02:43:30.509 INFO:tasks.workunit.client.1.trial106.stdout: 10 49927 12.66 MB/sec execute 93 sec latency 95.466 ms 2026-02-20T02:43:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:30 trial098 ceph-mon[38923]: pgmap v586: 129 pgs: 129 active+clean; 428 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.4 MiB/s wr, 256 op/s 2026-02-20T02:43:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:30 trial106 ceph-mon[44052]: pgmap v586: 129 pgs: 129 active+clean; 428 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.4 MiB/s wr, 256 op/s 2026-02-20T02:43:31.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18612632 4705.48 MB/sec execute 94 sec latency 2.348 ms 2026-02-20T02:43:31.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 50112 12.59 MB/sec execute 94 sec latency 42.991 ms 2026-02-20T02:43:32.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18706951 4709.74 MB/sec execute 95 sec latency 4.260 ms 2026-02-20T02:43:32.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 50280 12.49 MB/sec execute 95 sec latency 62.037 ms 2026-02-20T02:43:33.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:32 trial098 ceph-mon[38923]: pgmap v587: 129 pgs: 129 active+clean; 437 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 287 op/s 2026-02-20T02:43:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:32 trial106 ceph-mon[44052]: pgmap v587: 129 pgs: 129 active+clean; 437 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 287 op/s 2026-02-20T02:43:33.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18799866 4713.57 MB/sec execute 96 sec latency 7.169 ms 2026-02-20T02:43:33.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 50489 12.40 MB/sec execute 96 sec latency 49.549 ms 2026-02-20T02:43:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:43:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:43:34.505 INFO:tasks.workunit.client.0.trial098.stdout: 10 18889489 4715.64 MB/sec execute 97 sec latency 30.877 ms 2026-02-20T02:43:34.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 50730 12.38 MB/sec execute 97 sec latency 66.351 ms 2026-02-20T02:43:35.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:34 trial098 ceph-mon[38923]: pgmap v588: 129 pgs: 129 active+clean; 442 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 6.1 MiB/s wr, 307 op/s 2026-02-20T02:43:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:34 trial106 ceph-mon[44052]: pgmap v588: 129 pgs: 129 active+clean; 442 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 6.1 MiB/s wr, 307 op/s 2026-02-20T02:43:35.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 18980602 4717.69 MB/sec execute 98 sec latency 21.646 ms 2026-02-20T02:43:35.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 50989 12.42 MB/sec execute 98 sec latency 55.863 ms 2026-02-20T02:43:36.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19071536 4719.51 MB/sec execute 99 sec latency 24.610 ms 2026-02-20T02:43:36.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 51240 12.43 MB/sec execute 99 sec latency 55.285 ms 2026-02-20T02:43:37.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:36 trial098 ceph-mon[38923]: pgmap v589: 129 pgs: 129 active+clean; 445 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 6.3 MiB/s wr, 351 op/s 2026-02-20T02:43:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:36 trial106 ceph-mon[44052]: pgmap v589: 129 pgs: 129 active+clean; 445 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 6.3 MiB/s wr, 351 op/s 2026-02-20T02:43:37.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19164628 4722.64 MB/sec execute 100 sec latency 3.644 ms 2026-02-20T02:43:37.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 51491 12.39 MB/sec execute 100 sec latency 49.278 ms 2026-02-20T02:43:38.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19258237 4726.53 MB/sec execute 101 sec latency 2.548 ms 2026-02-20T02:43:38.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 51740 12.30 MB/sec execute 101 sec latency 39.146 ms 2026-02-20T02:43:39.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:38 trial098 ceph-mon[38923]: pgmap v590: 129 pgs: 129 active+clean; 435 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 366 op/s 2026-02-20T02:43:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:38 trial106 ceph-mon[44052]: pgmap v590: 129 pgs: 129 active+clean; 435 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 366 op/s 2026-02-20T02:43:39.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19345964 4727.43 MB/sec execute 102 sec latency 34.416 ms 2026-02-20T02:43:39.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 51998 12.28 MB/sec execute 102 sec latency 58.155 ms 2026-02-20T02:43:40.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19438382 4729.85 MB/sec execute 103 sec latency 2.349 ms 2026-02-20T02:43:40.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 52270 12.35 MB/sec execute 103 sec latency 42.397 ms 2026-02-20T02:43:41.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:40 trial098 ceph-mon[38923]: pgmap v591: 129 pgs: 129 active+clean; 425 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 356 op/s 2026-02-20T02:43:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:40 trial106 ceph-mon[44052]: pgmap v591: 129 pgs: 129 active+clean; 425 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 356 op/s 2026-02-20T02:43:41.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19527818 4730.80 MB/sec execute 104 sec latency 49.949 ms 2026-02-20T02:43:41.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 52573 12.45 MB/sec execute 104 sec latency 71.184 ms 2026-02-20T02:43:42.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19528741 4686.17 MB/sec execute 105 sec latency 134.574 ms 2026-02-20T02:43:42.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 52694 12.46 MB/sec execute 105 sec latency 165.200 ms 2026-02-20T02:43:43.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:42 trial098 ceph-mon[38923]: pgmap v592: 129 pgs: 129 active+clean; 430 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 411 op/s 2026-02-20T02:43:43.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:42 trial106 ceph-mon[44052]: pgmap v592: 129 pgs: 129 active+clean; 430 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 411 op/s 2026-02-20T02:43:43.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19572646 4664.27 MB/sec execute 106 sec latency 81.026 ms 2026-02-20T02:43:43.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 52927 12.50 MB/sec execute 106 sec latency 142.093 ms 2026-02-20T02:43:44.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19663383 4666.61 MB/sec execute 107 sec latency 40.933 ms 2026-02-20T02:43:44.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 53133 12.54 MB/sec execute 107 sec latency 61.748 ms 2026-02-20T02:43:45.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:44 trial098 ceph-mon[38923]: pgmap v593: 129 pgs: 129 active+clean; 441 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.8 MiB/s wr, 358 op/s 2026-02-20T02:43:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:44 trial106 ceph-mon[44052]: pgmap v593: 129 pgs: 129 active+clean; 441 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.8 MiB/s wr, 358 op/s 2026-02-20T02:43:45.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19757196 4671.44 MB/sec execute 108 sec latency 2.903 ms 2026-02-20T02:43:45.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 53325 12.56 MB/sec execute 108 sec latency 58.606 ms 2026-02-20T02:43:46.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19851114 4675.19 MB/sec execute 109 sec latency 16.033 ms 2026-02-20T02:43:46.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 53556 12.59 MB/sec execute 109 sec latency 51.081 ms 2026-02-20T02:43:47.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:46 trial098 ceph-mon[38923]: pgmap v594: 129 pgs: 129 active+clean; 447 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.4 MiB/s wr, 320 op/s 2026-02-20T02:43:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:46 trial106 ceph-mon[44052]: pgmap v594: 129 pgs: 129 active+clean; 447 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.4 MiB/s wr, 320 op/s 2026-02-20T02:43:47.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 19945949 4679.20 MB/sec execute 110 sec latency 3.106 ms 2026-02-20T02:43:47.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 53726 12.51 MB/sec execute 110 sec latency 53.810 ms 2026-02-20T02:43:48.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20002233 4664.35 MB/sec execute 111 sec latency 166.171 ms 2026-02-20T02:43:48.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 53870 12.42 MB/sec execute 111 sec latency 95.018 ms 2026-02-20T02:43:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:48 trial098 ceph-mon[38923]: pgmap v595: 129 pgs: 129 active+clean; 451 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 220 op/s 2026-02-20T02:43:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:43:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:48 trial106 ceph-mon[44052]: pgmap v595: 129 pgs: 129 active+clean; 451 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 220 op/s 2026-02-20T02:43:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:43:49.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20076059 4658.41 MB/sec execute 112 sec latency 115.817 ms 2026-02-20T02:43:49.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 54056 12.33 MB/sec execute 112 sec latency 119.727 ms 2026-02-20T02:43:50.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20169760 4662.48 MB/sec execute 113 sec latency 3.092 ms 2026-02-20T02:43:50.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 54320 12.33 MB/sec execute 113 sec latency 43.369 ms 2026-02-20T02:43:51.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:50 trial098 ceph-mon[38923]: pgmap v596: 129 pgs: 129 active+clean; 457 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 5.7 MiB/s wr, 207 op/s 2026-02-20T02:43:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:50 trial106 ceph-mon[44052]: pgmap v596: 129 pgs: 129 active+clean; 457 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 5.7 MiB/s wr, 207 op/s 2026-02-20T02:43:51.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20263495 4666.66 MB/sec execute 114 sec latency 3.440 ms 2026-02-20T02:43:51.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 54584 12.38 MB/sec execute 114 sec latency 43.458 ms 2026-02-20T02:43:52.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20357453 4670.19 MB/sec execute 115 sec latency 3.214 ms 2026-02-20T02:43:52.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 54847 12.42 MB/sec execute 115 sec latency 45.354 ms 2026-02-20T02:43:53.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:52 trial098 ceph-mon[38923]: pgmap v597: 129 pgs: 129 active+clean; 460 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 252 op/s 2026-02-20T02:43:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:52 trial106 ceph-mon[44052]: pgmap v597: 129 pgs: 129 active+clean; 460 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 252 op/s 2026-02-20T02:43:53.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20452725 4674.17 MB/sec execute 116 sec latency 3.071 ms 2026-02-20T02:43:53.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 55081 12.34 MB/sec execute 116 sec latency 42.034 ms 2026-02-20T02:43:54.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20546522 4677.58 MB/sec execute 117 sec latency 18.527 ms 2026-02-20T02:43:54.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 55326 12.27 MB/sec execute 117 sec latency 39.481 ms 2026-02-20T02:43:55.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:54 trial098 ceph-mon[38923]: pgmap v598: 129 pgs: 129 active+clean; 437 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 6.1 MiB/s wr, 217 op/s 2026-02-20T02:43:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:54 trial106 ceph-mon[44052]: pgmap v598: 129 pgs: 129 active+clean; 437 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 6.1 MiB/s wr, 217 op/s 2026-02-20T02:43:55.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20641434 4682.09 MB/sec execute 118 sec latency 2.736 ms 2026-02-20T02:43:55.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 55589 12.27 MB/sec execute 118 sec latency 38.848 ms 2026-02-20T02:43:56.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20735399 4685.78 MB/sec execute 119 sec latency 2.484 ms 2026-02-20T02:43:56.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 55870 12.33 MB/sec execute 119 sec latency 51.268 ms 2026-02-20T02:43:57.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:56 trial098 ceph-mon[38923]: pgmap v599: 129 pgs: 129 active+clean; 412 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 5.2 MiB/s wr, 223 op/s 2026-02-20T02:43:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:56 trial106 ceph-mon[44052]: pgmap v599: 129 pgs: 129 active+clean; 412 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 5.2 MiB/s wr, 223 op/s 2026-02-20T02:43:57.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20829775 4689.17 MB/sec execute 120 sec latency 2.728 ms 2026-02-20T02:43:57.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 56193 12.44 MB/sec execute 120 sec latency 42.622 ms 2026-02-20T02:43:58.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 20924479 4692.62 MB/sec execute 121 sec latency 2.475 ms 2026-02-20T02:43:58.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 56514 12.55 MB/sec execute 121 sec latency 46.502 ms 2026-02-20T02:43:59.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:43:58 trial098 ceph-mon[38923]: pgmap v600: 129 pgs: 129 active+clean; 419 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 256 op/s 2026-02-20T02:43:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:43:58 trial106 ceph-mon[44052]: pgmap v600: 129 pgs: 129 active+clean; 419 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 256 op/s 2026-02-20T02:43:59.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 21014965 4694.25 MB/sec execute 122 sec latency 31.091 ms 2026-02-20T02:43:59.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 56713 12.58 MB/sec execute 122 sec latency 43.050 ms 2026-02-20T02:44:00.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 21109274 4698.12 MB/sec execute 123 sec latency 3.197 ms 2026-02-20T02:44:00.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 56929 12.62 MB/sec execute 123 sec latency 57.793 ms 2026-02-20T02:44:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:00 trial098 ceph-mon[38923]: pgmap v601: 129 pgs: 129 active+clean; 427 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.6 MiB/s wr, 273 op/s 2026-02-20T02:44:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:00 trial106 ceph-mon[44052]: pgmap v601: 129 pgs: 129 active+clean; 427 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.6 MiB/s wr, 273 op/s 2026-02-20T02:44:01.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 21203007 4701.52 MB/sec execute 124 sec latency 13.222 ms 2026-02-20T02:44:01.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 57137 12.61 MB/sec execute 124 sec latency 62.449 ms 2026-02-20T02:44:02.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 21298406 4705.11 MB/sec execute 125 sec latency 2.658 ms 2026-02-20T02:44:02.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 57308 12.54 MB/sec execute 125 sec latency 57.535 ms 2026-02-20T02:44:03.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:02 trial098 ceph-mon[38923]: pgmap v602: 129 pgs: 129 active+clean; 436 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 277 op/s 2026-02-20T02:44:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:02 trial106 ceph-mon[44052]: pgmap v602: 129 pgs: 129 active+clean; 436 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 277 op/s 2026-02-20T02:44:03.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 21392560 4708.03 MB/sec execute 126 sec latency 3.781 ms 2026-02-20T02:44:03.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 57507 12.47 MB/sec execute 126 sec latency 46.857 ms 2026-02-20T02:44:04.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:44:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:44:04.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 21439078 4690.82 MB/sec execute 127 sec latency 84.195 ms 2026-02-20T02:44:04.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 57662 12.43 MB/sec execute 127 sec latency 156.092 ms 2026-02-20T02:44:05.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:04 trial098 ceph-mon[38923]: pgmap v603: 129 pgs: 129 active+clean; 441 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 5.9 MiB/s wr, 212 op/s 2026-02-20T02:44:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:04 trial106 ceph-mon[44052]: pgmap v603: 129 pgs: 129 active+clean; 441 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 5.9 MiB/s wr, 212 op/s 2026-02-20T02:44:05.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 21459448 4662.69 MB/sec execute 128 sec latency 108.355 ms 2026-02-20T02:44:05.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 57808 12.37 MB/sec execute 128 sec latency 156.186 ms 2026-02-20T02:44:06.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 21552875 4666.17 MB/sec execute 129 sec latency 4.274 ms 2026-02-20T02:44:06.510 INFO:tasks.workunit.client.1.trial106.stdout: 10 58064 12.39 MB/sec execute 129 sec latency 55.192 ms 2026-02-20T02:44:07.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:06 trial098 ceph-mon[38923]: pgmap v604: 129 pgs: 129 active+clean; 444 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.1 MiB/s wr, 222 op/s 2026-02-20T02:44:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:06 trial106 ceph-mon[44052]: pgmap v604: 129 pgs: 129 active+clean; 444 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.1 MiB/s wr, 222 op/s 2026-02-20T02:44:07.506 INFO:tasks.workunit.client.0.trial098.stdout: 10 21646742 4669.86 MB/sec execute 130 sec latency 3.229 ms 2026-02-20T02:44:07.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 58312 12.39 MB/sec execute 130 sec latency 49.759 ms 2026-02-20T02:44:08.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 21741568 4673.23 MB/sec execute 131 sec latency 2.365 ms 2026-02-20T02:44:08.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 58562 12.38 MB/sec execute 131 sec latency 39.033 ms 2026-02-20T02:44:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:08 trial098 ceph-mon[38923]: pgmap v605: 129 pgs: 129 active+clean; 440 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 260 op/s 2026-02-20T02:44:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:08 trial106 ceph-mon[44052]: pgmap v605: 129 pgs: 129 active+clean; 440 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 260 op/s 2026-02-20T02:44:09.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 21836694 4676.73 MB/sec execute 132 sec latency 5.177 ms 2026-02-20T02:44:09.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 58806 12.31 MB/sec execute 132 sec latency 39.202 ms 2026-02-20T02:44:10.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 21930957 4679.89 MB/sec execute 133 sec latency 8.984 ms 2026-02-20T02:44:10.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 59071 12.30 MB/sec execute 133 sec latency 36.286 ms 2026-02-20T02:44:11.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:10 trial098 ceph-mon[38923]: pgmap v606: 129 pgs: 129 active+clean; 429 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.0 MiB/s wr, 227 op/s 2026-02-20T02:44:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:10 trial106 ceph-mon[44052]: pgmap v606: 129 pgs: 129 active+clean; 429 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.0 MiB/s wr, 227 op/s 2026-02-20T02:44:11.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22024634 4683.30 MB/sec execute 134 sec latency 3.396 ms 2026-02-20T02:44:11.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 59346 12.34 MB/sec execute 134 sec latency 46.210 ms 2026-02-20T02:44:12.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22118225 4686.48 MB/sec execute 135 sec latency 2.474 ms 2026-02-20T02:44:12.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 59648 12.42 MB/sec execute 135 sec latency 47.164 ms 2026-02-20T02:44:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:12 trial106 ceph-mon[44052]: pgmap v607: 129 pgs: 129 active+clean; 430 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 262 op/s 2026-02-20T02:44:13.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:12 trial098 ceph-mon[38923]: pgmap v607: 129 pgs: 129 active+clean; 430 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 262 op/s 2026-02-20T02:44:13.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22211910 4689.19 MB/sec execute 136 sec latency 2.196 ms 2026-02-20T02:44:13.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 59992 12.55 MB/sec execute 136 sec latency 51.932 ms 2026-02-20T02:44:14.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22302304 4690.61 MB/sec execute 137 sec latency 2.602 ms 2026-02-20T02:44:14.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 60234 12.59 MB/sec execute 137 sec latency 43.168 ms 2026-02-20T02:44:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:14 trial106 ceph-mon[44052]: pgmap v608: 129 pgs: 129 active+clean; 437 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2026-02-20T02:44:15.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:14 trial098 ceph-mon[38923]: pgmap v608: 129 pgs: 129 active+clean; 437 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2026-02-20T02:44:15.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22394585 4692.70 MB/sec execute 138 sec latency 16.900 ms 2026-02-20T02:44:15.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 60421 12.60 MB/sec execute 138 sec latency 71.941 ms 2026-02-20T02:44:16.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22488628 4696.10 MB/sec execute 139 sec latency 2.003 ms 2026-02-20T02:44:16.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 60654 12.62 MB/sec execute 139 sec latency 69.871 ms 2026-02-20T02:44:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:16 trial106 ceph-mon[44052]: pgmap v609: 129 pgs: 129 active+clean; 446 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 261 op/s 2026-02-20T02:44:17.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:16 trial098 ceph-mon[38923]: pgmap v609: 129 pgs: 129 active+clean; 446 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 261 op/s 2026-02-20T02:44:17.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22582173 4698.93 MB/sec execute 140 sec latency 13.796 ms 2026-02-20T02:44:17.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 60825 12.56 MB/sec execute 140 sec latency 56.952 ms 2026-02-20T02:44:18.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22676289 4701.58 MB/sec execute 141 sec latency 2.906 ms 2026-02-20T02:44:18.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 61014 12.50 MB/sec execute 141 sec latency 56.525 ms 2026-02-20T02:44:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:18 trial106 ceph-mon[44052]: pgmap v610: 129 pgs: 129 active+clean; 457 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 271 op/s 2026-02-20T02:44:19.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:44:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:18 trial098 ceph-mon[38923]: pgmap v610: 129 pgs: 129 active+clean; 457 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 271 op/s 2026-02-20T02:44:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:44:19.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22769500 4704.03 MB/sec execute 142 sec latency 2.167 ms 2026-02-20T02:44:19.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 61231 12.46 MB/sec execute 142 sec latency 62.350 ms 2026-02-20T02:44:20.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22860973 4705.59 MB/sec execute 143 sec latency 26.165 ms 2026-02-20T02:44:20.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 61492 12.46 MB/sec execute 143 sec latency 48.329 ms 2026-02-20T02:44:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:20 trial106 ceph-mon[44052]: pgmap v611: 129 pgs: 129 active+clean; 461 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.1 MiB/s wr, 229 op/s 2026-02-20T02:44:21.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:20 trial098 ceph-mon[38923]: pgmap v611: 129 pgs: 129 active+clean; 461 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.1 MiB/s wr, 229 op/s 2026-02-20T02:44:21.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22897302 4686.63 MB/sec execute 144 sec latency 92.906 ms 2026-02-20T02:44:21.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 61656 12.44 MB/sec execute 144 sec latency 119.024 ms 2026-02-20T02:44:22.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 22925797 4665.27 MB/sec execute 145 sec latency 115.947 ms 2026-02-20T02:44:22.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 61815 12.40 MB/sec execute 145 sec latency 107.368 ms 2026-02-20T02:44:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:22 trial106 ceph-mon[44052]: pgmap v612: 129 pgs: 129 active+clean; 442 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 243 op/s 2026-02-20T02:44:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:22 trial098 ceph-mon[38923]: pgmap v612: 129 pgs: 129 active+clean; 442 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 243 op/s 2026-02-20T02:44:23.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23020305 4668.72 MB/sec execute 146 sec latency 2.580 ms 2026-02-20T02:44:23.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 62079 12.41 MB/sec execute 146 sec latency 41.346 ms 2026-02-20T02:44:24.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23115590 4671.99 MB/sec execute 147 sec latency 2.815 ms 2026-02-20T02:44:24.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 62320 12.35 MB/sec execute 147 sec latency 43.860 ms 2026-02-20T02:44:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:24 trial106 ceph-mon[44052]: pgmap v613: 129 pgs: 129 active+clean; 428 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.5 MiB/s wr, 236 op/s 2026-02-20T02:44:25.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:24 trial098 ceph-mon[38923]: pgmap v613: 129 pgs: 129 active+clean; 428 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.5 MiB/s wr, 236 op/s 2026-02-20T02:44:25.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23210623 4675.13 MB/sec execute 148 sec latency 11.043 ms 2026-02-20T02:44:25.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 62580 12.33 MB/sec execute 148 sec latency 39.566 ms 2026-02-20T02:44:26.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23305165 4677.97 MB/sec execute 149 sec latency 3.337 ms 2026-02-20T02:44:26.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 62844 12.34 MB/sec execute 149 sec latency 41.672 ms 2026-02-20T02:44:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:26 trial106 ceph-mon[44052]: pgmap v614: 129 pgs: 129 active+clean; 414 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.0 MiB/s wr, 251 op/s 2026-02-20T02:44:27.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:26 trial098 ceph-mon[38923]: pgmap v614: 129 pgs: 129 active+clean; 414 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.0 MiB/s wr, 251 op/s 2026-02-20T02:44:27.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23397734 4680.60 MB/sec execute 150 sec latency 18.214 ms 2026-02-20T02:44:27.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 63152 12.43 MB/sec execute 150 sec latency 44.593 ms 2026-02-20T02:44:28.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23453394 4669.77 MB/sec execute 151 sec latency 62.659 ms 2026-02-20T02:44:28.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 63416 12.52 MB/sec execute 151 sec latency 128.011 ms 2026-02-20T02:44:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:28 trial106 ceph-mon[44052]: pgmap v615: 129 pgs: 129 active+clean; 417 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 250 op/s 2026-02-20T02:44:29.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:28 trial098 ceph-mon[38923]: pgmap v615: 129 pgs: 129 active+clean; 417 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 250 op/s 2026-02-20T02:44:29.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23548092 4672.82 MB/sec execute 152 sec latency 4.030 ms 2026-02-20T02:44:29.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 63713 12.57 MB/sec execute 152 sec latency 42.862 ms 2026-02-20T02:44:30.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:29 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:44:30.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:29 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:44:30.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 23640354 4674.76 MB/sec execute 153 sec latency 13.809 ms 2026-02-20T02:44:30.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 63885 12.56 MB/sec execute 153 sec latency 45.796 ms 2026-02-20T02:44:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:30 trial106 ceph-mon[44052]: pgmap v616: 129 pgs: 129 active+clean; 429 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.1 MiB/s wr, 238 op/s 2026-02-20T02:44:31.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:44:31.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:44:31.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:44:31.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:30 trial098 ceph-mon[38923]: pgmap v616: 129 pgs: 129 active+clean; 429 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.1 MiB/s wr, 238 op/s 2026-02-20T02:44:31.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:44:31.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:44:31.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:44:31.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23733942 4677.27 MB/sec execute 154 sec latency 3.911 ms 2026-02-20T02:44:31.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 64120 12.61 MB/sec execute 154 sec latency 50.619 ms 2026-02-20T02:44:32.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23828530 4680.17 MB/sec execute 155 sec latency 2.741 ms 2026-02-20T02:44:32.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 64305 12.57 MB/sec execute 155 sec latency 46.915 ms 2026-02-20T02:44:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:32 trial106 ceph-mon[44052]: pgmap v617: 129 pgs: 129 active+clean; 441 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 266 op/s 2026-02-20T02:44:33.128 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:32 trial098 ceph-mon[38923]: pgmap v617: 129 pgs: 129 active+clean; 441 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 266 op/s 2026-02-20T02:44:33.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 23920752 4682.87 MB/sec execute 156 sec latency 2.998 ms 2026-02-20T02:44:33.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 64482 12.52 MB/sec execute 156 sec latency 63.339 ms 2026-02-20T02:44:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:44:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:44:34.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 24016539 4685.96 MB/sec execute 157 sec latency 2.611 ms 2026-02-20T02:44:34.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 64695 12.48 MB/sec execute 157 sec latency 44.691 ms 2026-02-20T02:44:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:34 trial106 ceph-mon[44052]: pgmap v618: 129 pgs: 129 active+clean; 443 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 5.9 MiB/s wr, 241 op/s 2026-02-20T02:44:35.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:34 trial098 ceph-mon[38923]: pgmap v618: 129 pgs: 129 active+clean; 443 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 5.9 MiB/s wr, 241 op/s 2026-02-20T02:44:35.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 24108259 4687.52 MB/sec execute 158 sec latency 20.468 ms 2026-02-20T02:44:35.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 64934 12.44 MB/sec execute 158 sec latency 57.216 ms 2026-02-20T02:44:36.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 24202142 4690.06 MB/sec execute 159 sec latency 4.350 ms 2026-02-20T02:44:36.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 65200 12.46 MB/sec execute 159 sec latency 41.755 ms 2026-02-20T02:44:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:36 trial106 ceph-mon[44052]: pgmap v619: 129 pgs: 129 active+clean; 446 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.1 MiB/s wr, 230 op/s 2026-02-20T02:44:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:36 trial098 ceph-mon[38923]: pgmap v619: 129 pgs: 129 active+clean; 446 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.1 MiB/s wr, 230 op/s 2026-02-20T02:44:37.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 24295744 4692.52 MB/sec execute 160 sec latency 10.709 ms 2026-02-20T02:44:37.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 65448 12.46 MB/sec execute 160 sec latency 53.863 ms 2026-02-20T02:44:38.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 24384284 4693.68 MB/sec execute 161 sec latency 57.327 ms 2026-02-20T02:44:38.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 65694 12.45 MB/sec execute 161 sec latency 58.646 ms 2026-02-20T02:44:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:38 trial106 ceph-mon[44052]: pgmap v620: 129 pgs: 129 active+clean; 446 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 252 op/s 2026-02-20T02:44:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:38 trial098 ceph-mon[38923]: pgmap v620: 129 pgs: 129 active+clean; 446 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 252 op/s 2026-02-20T02:44:39.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 24479307 4696.33 MB/sec execute 162 sec latency 2.497 ms 2026-02-20T02:44:39.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 65955 12.42 MB/sec execute 162 sec latency 40.475 ms 2026-02-20T02:44:40.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 24573692 4698.77 MB/sec execute 163 sec latency 10.294 ms 2026-02-20T02:44:40.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 66210 12.40 MB/sec execute 163 sec latency 44.336 ms 2026-02-20T02:44:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:40 trial106 ceph-mon[44052]: pgmap v621: 129 pgs: 129 active+clean; 437 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s rd, 6.5 MiB/s wr, 275 op/s 2026-02-20T02:44:41.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:40 trial098 ceph-mon[38923]: pgmap v621: 129 pgs: 129 active+clean; 437 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s rd, 6.5 MiB/s wr, 275 op/s 2026-02-20T02:44:41.507 INFO:tasks.workunit.client.0.trial098.stdout: 10 24668302 4701.34 MB/sec execute 164 sec latency 2.738 ms 2026-02-20T02:44:41.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 66482 12.44 MB/sec execute 164 sec latency 50.198 ms 2026-02-20T02:44:42.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 24762426 4704.00 MB/sec execute 165 sec latency 4.396 ms 2026-02-20T02:44:42.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 66787 12.51 MB/sec execute 165 sec latency 42.828 ms 2026-02-20T02:44:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:42 trial106 ceph-mon[44052]: pgmap v622: 129 pgs: 129 active+clean; 432 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 265 op/s 2026-02-20T02:44:43.266 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:42 trial098 ceph-mon[38923]: pgmap v622: 129 pgs: 129 active+clean; 432 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 265 op/s 2026-02-20T02:44:43.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 24847258 4703.70 MB/sec execute 166 sec latency 59.445 ms 2026-02-20T02:44:43.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 67085 12.58 MB/sec execute 166 sec latency 82.171 ms 2026-02-20T02:44:44.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 24848430 4675.92 MB/sec execute 167 sec latency 104.067 ms 2026-02-20T02:44:44.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 67184 12.54 MB/sec execute 167 sec latency 136.040 ms 2026-02-20T02:44:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:44 trial106 ceph-mon[44052]: pgmap v623: 129 pgs: 129 active+clean; 438 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 238 op/s 2026-02-20T02:44:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:44 trial098 ceph-mon[38923]: pgmap v623: 129 pgs: 129 active+clean; 438 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 238 op/s 2026-02-20T02:44:45.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 24928537 4673.80 MB/sec execute 168 sec latency 66.326 ms 2026-02-20T02:44:45.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 67379 12.56 MB/sec execute 168 sec latency 135.625 ms 2026-02-20T02:44:46.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25023901 4676.51 MB/sec execute 169 sec latency 3.632 ms 2026-02-20T02:44:46.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 67583 12.58 MB/sec execute 169 sec latency 42.861 ms 2026-02-20T02:44:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:46 trial106 ceph-mon[44052]: pgmap v624: 129 pgs: 129 active+clean; 451 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 272 op/s 2026-02-20T02:44:47.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:46 trial098 ceph-mon[38923]: pgmap v624: 129 pgs: 129 active+clean; 451 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 272 op/s 2026-02-20T02:44:47.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25119801 4679.55 MB/sec execute 170 sec latency 2.147 ms 2026-02-20T02:44:47.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 67791 12.57 MB/sec execute 170 sec latency 73.457 ms 2026-02-20T02:44:48.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25213835 4682.16 MB/sec execute 171 sec latency 3.107 ms 2026-02-20T02:44:48.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 67967 12.53 MB/sec execute 171 sec latency 58.026 ms 2026-02-20T02:44:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:48 trial106 ceph-mon[44052]: pgmap v625: 129 pgs: 129 active+clean; 451 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 240 op/s 2026-02-20T02:44:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:44:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:48 trial098 ceph-mon[38923]: pgmap v625: 129 pgs: 129 active+clean; 451 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 240 op/s 2026-02-20T02:44:49.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:44:49.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25307574 4684.88 MB/sec execute 172 sec latency 2.697 ms 2026-02-20T02:44:49.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 68163 12.49 MB/sec execute 172 sec latency 53.110 ms 2026-02-20T02:44:50.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25401277 4687.06 MB/sec execute 173 sec latency 4.178 ms 2026-02-20T02:44:50.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 68400 12.45 MB/sec execute 173 sec latency 47.469 ms 2026-02-20T02:44:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:50 trial106 ceph-mon[44052]: pgmap v626: 129 pgs: 129 active+clean; 454 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 5.9 MiB/s wr, 228 op/s 2026-02-20T02:44:51.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:50 trial098 ceph-mon[38923]: pgmap v626: 129 pgs: 129 active+clean; 454 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 5.9 MiB/s wr, 228 op/s 2026-02-20T02:44:51.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25494886 4689.21 MB/sec execute 174 sec latency 15.106 ms 2026-02-20T02:44:51.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 68655 12.45 MB/sec execute 174 sec latency 50.421 ms 2026-02-20T02:44:52.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25589665 4691.59 MB/sec execute 175 sec latency 4.782 ms 2026-02-20T02:44:52.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 68915 12.46 MB/sec execute 175 sec latency 45.696 ms 2026-02-20T02:44:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:52 trial106 ceph-mon[44052]: pgmap v627: 129 pgs: 129 active+clean; 433 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 203 op/s 2026-02-20T02:44:53.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:52 trial098 ceph-mon[38923]: pgmap v627: 129 pgs: 129 active+clean; 433 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 203 op/s 2026-02-20T02:44:53.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25683018 4694.00 MB/sec execute 176 sec latency 14.626 ms 2026-02-20T02:44:53.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 69168 12.47 MB/sec execute 176 sec latency 46.832 ms 2026-02-20T02:44:54.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25777701 4696.70 MB/sec execute 177 sec latency 3.029 ms 2026-02-20T02:44:54.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 69409 12.42 MB/sec execute 177 sec latency 47.523 ms 2026-02-20T02:44:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:54 trial106 ceph-mon[44052]: pgmap v628: 129 pgs: 129 active+clean; 424 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.1 MiB/s wr, 210 op/s 2026-02-20T02:44:55.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:54 trial098 ceph-mon[38923]: pgmap v628: 129 pgs: 129 active+clean; 424 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.1 MiB/s wr, 210 op/s 2026-02-20T02:44:55.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25869695 4698.16 MB/sec execute 178 sec latency 30.150 ms 2026-02-20T02:44:55.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 69672 12.41 MB/sec execute 178 sec latency 45.384 ms 2026-02-20T02:44:56.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 25963152 4700.18 MB/sec execute 179 sec latency 13.769 ms 2026-02-20T02:44:56.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 69946 12.43 MB/sec execute 179 sec latency 44.100 ms 2026-02-20T02:44:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:56 trial106 ceph-mon[44052]: pgmap v629: 129 pgs: 129 active+clean; 419 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.9 MiB/s wr, 262 op/s 2026-02-20T02:44:57.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:56 trial098 ceph-mon[38923]: pgmap v629: 129 pgs: 129 active+clean; 419 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.9 MiB/s wr, 262 op/s 2026-02-20T02:44:57.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26057043 4702.18 MB/sec execute 180 sec latency 2.681 ms 2026-02-20T02:44:57.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 70237 12.47 MB/sec execute 180 sec latency 50.690 ms 2026-02-20T02:44:58.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26150885 4704.67 MB/sec execute 181 sec latency 3.343 ms 2026-02-20T02:44:58.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 70577 12.58 MB/sec execute 181 sec latency 44.100 ms 2026-02-20T02:44:58.565 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:44:58 trial098 ceph-mon[38923]: pgmap v630: 129 pgs: 129 active+clean; 422 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 262 op/s 2026-02-20T02:44:58.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:44:58 trial106 ceph-mon[44052]: pgmap v630: 129 pgs: 129 active+clean; 422 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 262 op/s 2026-02-20T02:44:59.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26244428 4706.88 MB/sec execute 182 sec latency 2.159 ms 2026-02-20T02:44:59.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 70846 12.61 MB/sec execute 182 sec latency 44.365 ms 2026-02-20T02:45:00.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26319644 4703.28 MB/sec execute 183 sec latency 73.186 ms 2026-02-20T02:45:00.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 71009 12.62 MB/sec execute 183 sec latency 97.995 ms 2026-02-20T02:45:01.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:00 trial098 ceph-mon[38923]: pgmap v631: 129 pgs: 129 active+clean; 428 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.3 MiB/s wr, 267 op/s 2026-02-20T02:45:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:00 trial106 ceph-mon[44052]: pgmap v631: 129 pgs: 129 active+clean; 428 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.3 MiB/s wr, 267 op/s 2026-02-20T02:45:01.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26320901 4678.11 MB/sec execute 184 sec latency 147.067 ms 2026-02-20T02:45:01.511 INFO:tasks.workunit.client.1.trial106.stdout: 10 71089 12.57 MB/sec execute 184 sec latency 155.523 ms 2026-02-20T02:45:02.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26394282 4674.18 MB/sec execute 185 sec latency 67.834 ms 2026-02-20T02:45:02.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 71285 12.58 MB/sec execute 185 sec latency 139.359 ms 2026-02-20T02:45:03.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:02 trial098 ceph-mon[38923]: pgmap v632: 129 pgs: 129 active+clean; 436 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.3 MiB/s wr, 248 op/s 2026-02-20T02:45:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:02 trial106 ceph-mon[44052]: pgmap v632: 129 pgs: 129 active+clean; 436 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.3 MiB/s wr, 248 op/s 2026-02-20T02:45:03.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26488545 4676.45 MB/sec execute 186 sec latency 13.443 ms 2026-02-20T02:45:03.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 71471 12.54 MB/sec execute 186 sec latency 50.483 ms 2026-02-20T02:45:03.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:45:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:45:04.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26583215 4678.99 MB/sec execute 187 sec latency 3.049 ms 2026-02-20T02:45:04.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 71672 12.51 MB/sec execute 187 sec latency 45.746 ms 2026-02-20T02:45:05.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:04 trial098 ceph-mon[38923]: pgmap v633: 129 pgs: 129 active+clean; 443 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.2 MiB/s wr, 261 op/s 2026-02-20T02:45:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:04 trial106 ceph-mon[44052]: pgmap v633: 129 pgs: 129 active+clean; 443 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.2 MiB/s wr, 261 op/s 2026-02-20T02:45:05.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26677643 4681.70 MB/sec execute 188 sec latency 2.608 ms 2026-02-20T02:45:05.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 71889 12.47 MB/sec execute 188 sec latency 47.640 ms 2026-02-20T02:45:06.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26766737 4682.45 MB/sec execute 189 sec latency 20.066 ms 2026-02-20T02:45:06.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 72144 12.47 MB/sec execute 189 sec latency 49.374 ms 2026-02-20T02:45:07.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:06 trial098 ceph-mon[38923]: pgmap v634: 129 pgs: 129 active+clean; 444 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 237 op/s 2026-02-20T02:45:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:06 trial106 ceph-mon[44052]: pgmap v634: 129 pgs: 129 active+clean; 444 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 237 op/s 2026-02-20T02:45:07.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26810809 4670.29 MB/sec execute 190 sec latency 91.437 ms 2026-02-20T02:45:07.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 72314 12.45 MB/sec execute 190 sec latency 192.533 ms 2026-02-20T02:45:08.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 26907590 4673.20 MB/sec execute 191 sec latency 2.056 ms 2026-02-20T02:45:08.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 72563 12.44 MB/sec execute 191 sec latency 86.083 ms 2026-02-20T02:45:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:08 trial098 ceph-mon[38923]: pgmap v635: 129 pgs: 129 active+clean; 442 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 192 op/s 2026-02-20T02:45:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:08 trial106 ceph-mon[44052]: pgmap v635: 129 pgs: 129 active+clean; 442 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 192 op/s 2026-02-20T02:45:09.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 27002537 4675.55 MB/sec execute 192 sec latency 3.868 ms 2026-02-20T02:45:09.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 72823 12.44 MB/sec execute 192 sec latency 40.125 ms 2026-02-20T02:45:10.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 27096396 4678.28 MB/sec execute 193 sec latency 4.534 ms 2026-02-20T02:45:10.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 73090 12.41 MB/sec execute 193 sec latency 45.586 ms 2026-02-20T02:45:11.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:10 trial098 ceph-mon[38923]: pgmap v636: 129 pgs: 129 active+clean; 439 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 6.1 MiB/s wr, 226 op/s 2026-02-20T02:45:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:10 trial106 ceph-mon[44052]: pgmap v636: 129 pgs: 129 active+clean; 439 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 6.1 MiB/s wr, 226 op/s 2026-02-20T02:45:11.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 27190745 4680.44 MB/sec execute 194 sec latency 2.095 ms 2026-02-20T02:45:11.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 73367 12.40 MB/sec execute 194 sec latency 42.334 ms 2026-02-20T02:45:12.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 27284372 4682.32 MB/sec execute 195 sec latency 2.453 ms 2026-02-20T02:45:12.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 73643 12.44 MB/sec execute 195 sec latency 44.492 ms 2026-02-20T02:45:13.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:12 trial098 ceph-mon[38923]: pgmap v637: 129 pgs: 129 active+clean; 435 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 239 op/s 2026-02-20T02:45:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:12 trial106 ceph-mon[44052]: pgmap v637: 129 pgs: 129 active+clean; 435 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 239 op/s 2026-02-20T02:45:13.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 27326398 4670.06 MB/sec execute 196 sec latency 155.337 ms 2026-02-20T02:45:13.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 73878 12.47 MB/sec execute 196 sec latency 113.206 ms 2026-02-20T02:45:14.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 27420637 4672.17 MB/sec execute 197 sec latency 2.461 ms 2026-02-20T02:45:14.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 74181 12.54 MB/sec execute 197 sec latency 51.930 ms 2026-02-20T02:45:15.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:14 trial098 ceph-mon[38923]: pgmap v638: 129 pgs: 129 active+clean; 436 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 5.4 MiB/s wr, 246 op/s 2026-02-20T02:45:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:14 trial106 ceph-mon[44052]: pgmap v638: 129 pgs: 129 active+clean; 436 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 5.4 MiB/s wr, 246 op/s 2026-02-20T02:45:15.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 27514377 4674.43 MB/sec execute 198 sec latency 2.905 ms 2026-02-20T02:45:15.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 74451 12.58 MB/sec execute 198 sec latency 47.916 ms 2026-02-20T02:45:16.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 27603141 4675.41 MB/sec execute 199 sec latency 57.450 ms 2026-02-20T02:45:16.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 74617 12.57 MB/sec execute 199 sec latency 59.727 ms 2026-02-20T02:45:17.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:16 trial098 ceph-mon[38923]: pgmap v639: 129 pgs: 129 active+clean; 446 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 5.1 MiB/s wr, 251 op/s 2026-02-20T02:45:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:16 trial106 ceph-mon[44052]: pgmap v639: 129 pgs: 129 active+clean; 446 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 5.1 MiB/s wr, 251 op/s 2026-02-20T02:45:17.508 INFO:tasks.workunit.client.0.trial098.stdout: 10 27697750 4677.54 MB/sec execute 200 sec latency 2.339 ms 2026-02-20T02:45:17.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 74845 12.59 MB/sec execute 200 sec latency 68.214 ms 2026-02-20T02:45:18.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 27765434 4672.44 MB/sec execute 201 sec latency 96.337 ms 2026-02-20T02:45:18.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 74999 12.56 MB/sec execute 201 sec latency 136.249 ms 2026-02-20T02:45:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:18 trial098 ceph-mon[38923]: pgmap v640: 129 pgs: 129 active+clean; 453 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 253 op/s 2026-02-20T02:45:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:45:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:18 trial106 ceph-mon[44052]: pgmap v640: 129 pgs: 129 active+clean; 453 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 253 op/s 2026-02-20T02:45:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:45:19.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 27831191 4666.94 MB/sec execute 202 sec latency 112.702 ms 2026-02-20T02:45:19.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 75146 12.51 MB/sec execute 202 sec latency 139.222 ms 2026-02-20T02:45:20.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 27926159 4669.27 MB/sec execute 203 sec latency 112.702 ms 2026-02-20T02:45:20.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 75353 12.48 MB/sec execute 203 sec latency 48.872 ms 2026-02-20T02:45:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:20 trial098 ceph-mon[38923]: pgmap v641: 129 pgs: 129 active+clean; 440 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 256 op/s 2026-02-20T02:45:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:20 trial106 ceph-mon[44052]: pgmap v641: 129 pgs: 129 active+clean; 440 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 256 op/s 2026-02-20T02:45:21.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28020157 4671.78 MB/sec execute 204 sec latency 3.050 ms 2026-02-20T02:45:21.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 75583 12.45 MB/sec execute 204 sec latency 55.516 ms 2026-02-20T02:45:22.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28113550 4673.60 MB/sec execute 205 sec latency 2.827 ms 2026-02-20T02:45:22.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 75840 12.46 MB/sec execute 205 sec latency 55.119 ms 2026-02-20T02:45:23.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:22 trial098 ceph-mon[38923]: pgmap v642: 129 pgs: 129 active+clean; 432 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 217 op/s 2026-02-20T02:45:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:22 trial106 ceph-mon[44052]: pgmap v642: 129 pgs: 129 active+clean; 432 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 217 op/s 2026-02-20T02:45:23.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28205537 4675.01 MB/sec execute 206 sec latency 20.143 ms 2026-02-20T02:45:23.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 76090 12.45 MB/sec execute 206 sec latency 47.358 ms 2026-02-20T02:45:24.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28261768 4667.16 MB/sec execute 207 sec latency 92.139 ms 2026-02-20T02:45:24.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 76293 12.45 MB/sec execute 207 sec latency 124.050 ms 2026-02-20T02:45:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:24 trial098 ceph-mon[38923]: pgmap v643: 129 pgs: 129 active+clean; 429 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.6 MiB/s wr, 252 op/s 2026-02-20T02:45:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:24 trial106 ceph-mon[44052]: pgmap v643: 129 pgs: 129 active+clean; 429 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.6 MiB/s wr, 252 op/s 2026-02-20T02:45:25.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28356965 4669.40 MB/sec execute 208 sec latency 3.488 ms 2026-02-20T02:45:25.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 76540 12.43 MB/sec execute 208 sec latency 37.469 ms 2026-02-20T02:45:26.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28450097 4671.50 MB/sec execute 209 sec latency 15.157 ms 2026-02-20T02:45:26.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 76805 12.40 MB/sec execute 209 sec latency 42.648 ms 2026-02-20T02:45:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:26 trial098 ceph-mon[38923]: pgmap v644: 129 pgs: 129 active+clean; 423 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.3 MiB/s wr, 246 op/s 2026-02-20T02:45:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:26 trial106 ceph-mon[44052]: pgmap v644: 129 pgs: 129 active+clean; 423 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.3 MiB/s wr, 246 op/s 2026-02-20T02:45:27.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28545093 4673.95 MB/sec execute 210 sec latency 2.680 ms 2026-02-20T02:45:27.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 77068 12.41 MB/sec execute 210 sec latency 42.061 ms 2026-02-20T02:45:28.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28639773 4676.01 MB/sec execute 211 sec latency 3.449 ms 2026-02-20T02:45:28.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 77365 12.47 MB/sec execute 211 sec latency 43.476 ms 2026-02-20T02:45:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:28 trial098 ceph-mon[38923]: pgmap v645: 129 pgs: 129 active+clean; 417 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 241 op/s 2026-02-20T02:45:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:28 trial106 ceph-mon[44052]: pgmap v645: 129 pgs: 129 active+clean; 417 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 241 op/s 2026-02-20T02:45:29.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28734755 4678.17 MB/sec execute 212 sec latency 2.318 ms 2026-02-20T02:45:29.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 77684 12.53 MB/sec execute 212 sec latency 52.166 ms 2026-02-20T02:45:30.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28827297 4679.65 MB/sec execute 213 sec latency 2.915 ms 2026-02-20T02:45:30.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 77964 12.57 MB/sec execute 213 sec latency 45.660 ms 2026-02-20T02:45:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:30 trial098 ceph-mon[38923]: pgmap v646: 129 pgs: 129 active+clean; 423 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 273 op/s 2026-02-20T02:45:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:45:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:45:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:45:31.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:45:31.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:45:31.066 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:45:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:30 trial106 ceph-mon[44052]: pgmap v646: 129 pgs: 129 active+clean; 423 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 273 op/s 2026-02-20T02:45:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:45:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:45:31.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:45:31.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:45:31.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:45:31.118 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:45:31.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 28921637 4682.11 MB/sec execute 214 sec latency 2.823 ms 2026-02-20T02:45:31.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 78136 12.57 MB/sec execute 214 sec latency 52.687 ms 2026-02-20T02:45:32.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29013310 4683.43 MB/sec execute 215 sec latency 27.617 ms 2026-02-20T02:45:32.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 78358 12.59 MB/sec execute 215 sec latency 54.706 ms 2026-02-20T02:45:33.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:32 trial098 ceph-mon[38923]: pgmap v647: 129 pgs: 129 active+clean; 431 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2026-02-20T02:45:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:32 trial106 ceph-mon[44052]: pgmap v647: 129 pgs: 129 active+clean; 431 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2026-02-20T02:45:33.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29106964 4685.15 MB/sec execute 216 sec latency 3.323 ms 2026-02-20T02:45:33.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 78554 12.57 MB/sec execute 216 sec latency 57.939 ms 2026-02-20T02:45:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:45:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:45:34.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29202156 4687.32 MB/sec execute 217 sec latency 2.399 ms 2026-02-20T02:45:34.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 78748 12.54 MB/sec execute 217 sec latency 42.553 ms 2026-02-20T02:45:35.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:34 trial098 ceph-mon[38923]: pgmap v648: 129 pgs: 129 active+clean; 442 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.1 MiB/s wr, 269 op/s 2026-02-20T02:45:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:34 trial106 ceph-mon[44052]: pgmap v648: 129 pgs: 129 active+clean; 442 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.1 MiB/s wr, 269 op/s 2026-02-20T02:45:35.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29289852 4687.49 MB/sec execute 218 sec latency 58.878 ms 2026-02-20T02:45:35.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 78945 12.50 MB/sec execute 218 sec latency 81.259 ms 2026-02-20T02:45:36.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29383154 4689.66 MB/sec execute 219 sec latency 2.299 ms 2026-02-20T02:45:36.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 79191 12.48 MB/sec execute 219 sec latency 57.937 ms 2026-02-20T02:45:37.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:36 trial098 ceph-mon[38923]: pgmap v649: 129 pgs: 129 active+clean; 448 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.1 MiB/s wr, 241 op/s 2026-02-20T02:45:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:36 trial106 ceph-mon[44052]: pgmap v649: 129 pgs: 129 active+clean; 448 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.1 MiB/s wr, 241 op/s 2026-02-20T02:45:37.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29477535 4691.55 MB/sec execute 220 sec latency 2.426 ms 2026-02-20T02:45:37.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 79450 12.50 MB/sec execute 220 sec latency 51.758 ms 2026-02-20T02:45:38.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 29572835 4693.54 MB/sec execute 221 sec latency 3.672 ms 2026-02-20T02:45:38.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 79704 12.50 MB/sec execute 221 sec latency 47.023 ms 2026-02-20T02:45:39.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:38 trial098 ceph-mon[38923]: pgmap v650: 129 pgs: 129 active+clean; 443 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 226 op/s 2026-02-20T02:45:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:38 trial106 ceph-mon[44052]: pgmap v650: 129 pgs: 129 active+clean; 443 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 226 op/s 2026-02-20T02:45:39.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29666468 4695.24 MB/sec execute 222 sec latency 12.840 ms 2026-02-20T02:45:39.512 INFO:tasks.workunit.client.1.trial106.stdout: 10 79955 12.48 MB/sec execute 222 sec latency 43.696 ms 2026-02-20T02:45:40.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 29688332 4679.46 MB/sec execute 223 sec latency 85.982 ms 2026-02-20T02:45:40.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 80122 12.45 MB/sec execute 223 sec latency 126.615 ms 2026-02-20T02:45:41.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:40 trial098 ceph-mon[38923]: pgmap v651: 129 pgs: 129 active+clean; 437 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 6.3 MiB/s wr, 230 op/s 2026-02-20T02:45:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:40 trial106 ceph-mon[44052]: pgmap v651: 129 pgs: 129 active+clean; 437 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 6.3 MiB/s wr, 230 op/s 2026-02-20T02:45:41.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 29740225 4671.07 MB/sec execute 224 sec latency 90.364 ms 2026-02-20T02:45:41.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 80308 12.42 MB/sec execute 224 sec latency 141.787 ms 2026-02-20T02:45:42.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29829020 4672.02 MB/sec execute 225 sec latency 51.968 ms 2026-02-20T02:45:42.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 80583 12.43 MB/sec execute 225 sec latency 38.541 ms 2026-02-20T02:45:43.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:42 trial098 ceph-mon[38923]: pgmap v652: 129 pgs: 129 active+clean; 434 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 261 op/s 2026-02-20T02:45:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:42 trial106 ceph-mon[44052]: pgmap v652: 129 pgs: 129 active+clean; 434 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 261 op/s 2026-02-20T02:45:43.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 29923309 4674.07 MB/sec execute 226 sec latency 3.808 ms 2026-02-20T02:45:43.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 80890 12.48 MB/sec execute 226 sec latency 39.434 ms 2026-02-20T02:45:44.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30016213 4675.55 MB/sec execute 227 sec latency 7.182 ms 2026-02-20T02:45:44.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 81173 12.52 MB/sec execute 227 sec latency 49.429 ms 2026-02-20T02:45:45.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:44 trial098 ceph-mon[38923]: pgmap v653: 129 pgs: 129 active+clean; 433 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.8 MiB/s wr, 272 op/s 2026-02-20T02:45:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:44 trial106 ceph-mon[44052]: pgmap v653: 129 pgs: 129 active+clean; 433 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.8 MiB/s wr, 272 op/s 2026-02-20T02:45:45.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30110640 4677.50 MB/sec execute 228 sec latency 1.960 ms 2026-02-20T02:45:45.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 81489 12.58 MB/sec execute 228 sec latency 44.022 ms 2026-02-20T02:45:46.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30203677 4678.94 MB/sec execute 229 sec latency 3.480 ms 2026-02-20T02:45:46.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 81668 12.58 MB/sec execute 229 sec latency 45.765 ms 2026-02-20T02:45:47.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:46 trial098 ceph-mon[38923]: pgmap v654: 129 pgs: 129 active+clean; 442 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.1 MiB/s wr, 242 op/s 2026-02-20T02:45:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:46 trial106 ceph-mon[44052]: pgmap v654: 129 pgs: 129 active+clean; 442 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.1 MiB/s wr, 242 op/s 2026-02-20T02:45:47.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30295701 4680.69 MB/sec execute 230 sec latency 3.092 ms 2026-02-20T02:45:47.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 81902 12.60 MB/sec execute 230 sec latency 43.663 ms 2026-02-20T02:45:48.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30390514 4682.67 MB/sec execute 231 sec latency 3.652 ms 2026-02-20T02:45:48.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 82100 12.58 MB/sec execute 231 sec latency 71.297 ms 2026-02-20T02:45:49.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:48 trial098 ceph-mon[38923]: pgmap v655: 129 pgs: 129 active+clean; 452 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 243 op/s 2026-02-20T02:45:49.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:45:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:48 trial106 ceph-mon[44052]: pgmap v655: 129 pgs: 129 active+clean; 452 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 243 op/s 2026-02-20T02:45:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:45:49.509 INFO:tasks.workunit.client.0.trial098.stdout: 10 30484769 4684.39 MB/sec execute 232 sec latency 3.115 ms 2026-02-20T02:45:49.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 82293 12.55 MB/sec execute 232 sec latency 51.452 ms 2026-02-20T02:45:50.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30577549 4685.84 MB/sec execute 233 sec latency 3.231 ms 2026-02-20T02:45:50.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 82493 12.52 MB/sec execute 233 sec latency 58.596 ms 2026-02-20T02:45:51.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:50 trial098 ceph-mon[38923]: pgmap v656: 129 pgs: 129 active+clean; 455 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 5.9 MiB/s wr, 245 op/s 2026-02-20T02:45:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:50 trial106 ceph-mon[44052]: pgmap v656: 129 pgs: 129 active+clean; 455 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 5.9 MiB/s wr, 245 op/s 2026-02-20T02:45:51.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30671568 4687.54 MB/sec execute 234 sec latency 3.787 ms 2026-02-20T02:45:51.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 82747 12.51 MB/sec execute 234 sec latency 52.615 ms 2026-02-20T02:45:52.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30762906 4689.01 MB/sec execute 235 sec latency 11.112 ms 2026-02-20T02:45:52.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 82991 12.50 MB/sec execute 235 sec latency 45.345 ms 2026-02-20T02:45:53.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:52 trial098 ceph-mon[38923]: pgmap v657: 129 pgs: 129 active+clean; 441 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 253 op/s 2026-02-20T02:45:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:52 trial106 ceph-mon[44052]: pgmap v657: 129 pgs: 129 active+clean; 441 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 253 op/s 2026-02-20T02:45:53.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30853113 4689.84 MB/sec execute 236 sec latency 5.627 ms 2026-02-20T02:45:53.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 83253 12.52 MB/sec execute 236 sec latency 43.775 ms 2026-02-20T02:45:54.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 30945604 4691.13 MB/sec execute 237 sec latency 18.307 ms 2026-02-20T02:45:54.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 83496 12.50 MB/sec execute 237 sec latency 46.021 ms 2026-02-20T02:45:55.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:54 trial098 ceph-mon[38923]: pgmap v658: 129 pgs: 129 active+clean; 426 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.2 MiB/s wr, 202 op/s 2026-02-20T02:45:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:54 trial106 ceph-mon[44052]: pgmap v658: 129 pgs: 129 active+clean; 426 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.2 MiB/s wr, 202 op/s 2026-02-20T02:45:55.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31037781 4692.38 MB/sec execute 238 sec latency 2.335 ms 2026-02-20T02:45:55.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 83754 12.48 MB/sec execute 238 sec latency 59.660 ms 2026-02-20T02:45:56.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31132471 4694.15 MB/sec execute 239 sec latency 4.280 ms 2026-02-20T02:45:56.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 84009 12.46 MB/sec execute 239 sec latency 50.180 ms 2026-02-20T02:45:57.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:56 trial098 ceph-mon[38923]: pgmap v659: 129 pgs: 129 active+clean; 423 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.5 MiB/s wr, 255 op/s 2026-02-20T02:45:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:56 trial106 ceph-mon[44052]: pgmap v659: 129 pgs: 129 active+clean; 423 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.5 MiB/s wr, 255 op/s 2026-02-20T02:45:57.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31144964 4677.39 MB/sec execute 240 sec latency 91.306 ms 2026-02-20T02:45:57.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 84161 12.46 MB/sec execute 240 sec latency 105.916 ms 2026-02-20T02:45:58.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31193195 4669.05 MB/sec execute 241 sec latency 91.018 ms 2026-02-20T02:45:58.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 84353 12.46 MB/sec execute 241 sec latency 126.098 ms 2026-02-20T02:45:59.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:45:58 trial098 ceph-mon[38923]: pgmap v660: 129 pgs: 129 active+clean; 420 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 253 op/s 2026-02-20T02:45:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:45:58 trial106 ceph-mon[44052]: pgmap v660: 129 pgs: 129 active+clean; 420 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 253 op/s 2026-02-20T02:45:59.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31287607 4671.07 MB/sec execute 242 sec latency 2.377 ms 2026-02-20T02:45:59.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 84680 12.53 MB/sec execute 242 sec latency 45.241 ms 2026-02-20T02:46:00.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31382403 4672.87 MB/sec execute 243 sec latency 2.075 ms 2026-02-20T02:46:00.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 84969 12.57 MB/sec execute 243 sec latency 46.150 ms 2026-02-20T02:46:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:00 trial106 ceph-mon[44052]: pgmap v661: 129 pgs: 129 active+clean; 422 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s rd, 5.2 MiB/s wr, 244 op/s 2026-02-20T02:46:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:00 trial098 ceph-mon[38923]: pgmap v661: 129 pgs: 129 active+clean; 422 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s rd, 5.2 MiB/s wr, 244 op/s 2026-02-20T02:46:01.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31476504 4674.59 MB/sec execute 244 sec latency 4.062 ms 2026-02-20T02:46:01.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 85184 12.58 MB/sec execute 244 sec latency 62.676 ms 2026-02-20T02:46:02.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31570687 4676.28 MB/sec execute 245 sec latency 3.390 ms 2026-02-20T02:46:02.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 85392 12.59 MB/sec execute 245 sec latency 49.280 ms 2026-02-20T02:46:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:02 trial106 ceph-mon[44052]: pgmap v662: 129 pgs: 129 active+clean; 435 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 274 op/s 2026-02-20T02:46:03.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:02 trial098 ceph-mon[38923]: pgmap v662: 129 pgs: 129 active+clean; 435 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 274 op/s 2026-02-20T02:46:03.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31644689 4673.73 MB/sec execute 246 sec latency 84.043 ms 2026-02-20T02:46:03.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 85586 12.58 MB/sec execute 246 sec latency 129.805 ms 2026-02-20T02:46:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:46:04.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:46:04.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31712402 4669.85 MB/sec execute 247 sec latency 83.657 ms 2026-02-20T02:46:04.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 85739 12.55 MB/sec execute 247 sec latency 137.845 ms 2026-02-20T02:46:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:04 trial106 ceph-mon[44052]: pgmap v663: 129 pgs: 129 active+clean; 445 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 272 op/s 2026-02-20T02:46:05.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:04 trial098 ceph-mon[38923]: pgmap v663: 129 pgs: 129 active+clean; 445 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 272 op/s 2026-02-20T02:46:05.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31807073 4671.64 MB/sec execute 248 sec latency 4.400 ms 2026-02-20T02:46:05.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 85935 12.52 MB/sec execute 248 sec latency 49.976 ms 2026-02-20T02:46:06.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31900223 4673.14 MB/sec execute 249 sec latency 2.857 ms 2026-02-20T02:46:06.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 86159 12.49 MB/sec execute 249 sec latency 50.739 ms 2026-02-20T02:46:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:06 trial106 ceph-mon[44052]: pgmap v664: 129 pgs: 129 active+clean; 446 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 259 op/s 2026-02-20T02:46:07.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:06 trial098 ceph-mon[38923]: pgmap v664: 129 pgs: 129 active+clean; 446 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 259 op/s 2026-02-20T02:46:07.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 31993214 4674.52 MB/sec execute 250 sec latency 10.288 ms 2026-02-20T02:46:07.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 86426 12.50 MB/sec execute 250 sec latency 42.729 ms 2026-02-20T02:46:08.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 32087017 4676.19 MB/sec execute 251 sec latency 3.646 ms 2026-02-20T02:46:08.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 86671 12.49 MB/sec execute 251 sec latency 49.986 ms 2026-02-20T02:46:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:08 trial106 ceph-mon[44052]: pgmap v665: 129 pgs: 129 active+clean; 445 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 196 op/s 2026-02-20T02:46:09.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:08 trial098 ceph-mon[38923]: pgmap v665: 129 pgs: 129 active+clean; 445 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 196 op/s 2026-02-20T02:46:09.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 32140259 4669.39 MB/sec execute 252 sec latency 67.586 ms 2026-02-20T02:46:09.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 86881 12.49 MB/sec execute 252 sec latency 118.752 ms 2026-02-20T02:46:10.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 32234317 4671.05 MB/sec execute 253 sec latency 4.268 ms 2026-02-20T02:46:10.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 87132 12.48 MB/sec execute 253 sec latency 39.159 ms 2026-02-20T02:46:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:10 trial106 ceph-mon[44052]: pgmap v666: 129 pgs: 129 active+clean; 445 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 240 op/s 2026-02-20T02:46:11.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:10 trial098 ceph-mon[38923]: pgmap v666: 129 pgs: 129 active+clean; 445 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 240 op/s 2026-02-20T02:46:11.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 32328751 4672.79 MB/sec execute 254 sec latency 2.810 ms 2026-02-20T02:46:11.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 87399 12.46 MB/sec execute 254 sec latency 37.911 ms 2026-02-20T02:46:12.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 32422690 4674.34 MB/sec execute 255 sec latency 15.598 ms 2026-02-20T02:46:12.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 87657 12.47 MB/sec execute 255 sec latency 43.143 ms 2026-02-20T02:46:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:12 trial106 ceph-mon[44052]: pgmap v667: 129 pgs: 129 active+clean; 437 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 245 op/s 2026-02-20T02:46:13.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:12 trial098 ceph-mon[38923]: pgmap v667: 129 pgs: 129 active+clean; 437 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 245 op/s 2026-02-20T02:46:13.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 32516929 4675.99 MB/sec execute 256 sec latency 24.938 ms 2026-02-20T02:46:13.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 87955 12.50 MB/sec execute 256 sec latency 40.772 ms 2026-02-20T02:46:14.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 32610819 4677.96 MB/sec execute 257 sec latency 3.900 ms 2026-02-20T02:46:14.513 INFO:tasks.workunit.client.1.trial106.stdout: 10 88251 12.55 MB/sec execute 257 sec latency 48.563 ms 2026-02-20T02:46:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:14 trial106 ceph-mon[44052]: pgmap v668: 129 pgs: 129 active+clean; 438 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 252 op/s 2026-02-20T02:46:15.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:14 trial098 ceph-mon[38923]: pgmap v668: 129 pgs: 129 active+clean; 438 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 252 op/s 2026-02-20T02:46:15.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 32704066 4679.37 MB/sec execute 258 sec latency 12.814 ms 2026-02-20T02:46:15.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 88561 12.59 MB/sec execute 258 sec latency 39.547 ms 2026-02-20T02:46:16.510 INFO:tasks.workunit.client.0.trial098.stdout: 10 32798576 4681.04 MB/sec execute 259 sec latency 2.169 ms 2026-02-20T02:46:16.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 88752 12.60 MB/sec execute 259 sec latency 54.429 ms 2026-02-20T02:46:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:16 trial106 ceph-mon[44052]: pgmap v669: 129 pgs: 129 active+clean; 443 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 244 op/s 2026-02-20T02:46:17.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:16 trial098 ceph-mon[38923]: pgmap v669: 129 pgs: 129 active+clean; 443 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 244 op/s 2026-02-20T02:46:17.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 32892868 4682.56 MB/sec execute 260 sec latency 3.935 ms 2026-02-20T02:46:17.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 88957 12.60 MB/sec execute 260 sec latency 56.457 ms 2026-02-20T02:46:18.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 32986970 4684.21 MB/sec execute 261 sec latency 3.313 ms 2026-02-20T02:46:18.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 89175 12.60 MB/sec execute 261 sec latency 54.513 ms 2026-02-20T02:46:18.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:18 trial106 ceph-mon[44052]: pgmap v670: 129 pgs: 129 active+clean; 453 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 249 op/s 2026-02-20T02:46:18.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:18 trial098 ceph-mon[38923]: pgmap v670: 129 pgs: 129 active+clean; 453 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 249 op/s 2026-02-20T02:46:19.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33080375 4685.96 MB/sec execute 262 sec latency 3.003 ms 2026-02-20T02:46:19.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 89371 12.58 MB/sec execute 262 sec latency 57.705 ms 2026-02-20T02:46:19.564 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:19 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:46:19.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:19 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:46:20.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33169044 4686.36 MB/sec execute 263 sec latency 30.722 ms 2026-02-20T02:46:20.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 89556 12.54 MB/sec execute 263 sec latency 72.264 ms 2026-02-20T02:46:20.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:20 trial106 ceph-mon[44052]: pgmap v671: 129 pgs: 129 active+clean; 448 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.1 MiB/s wr, 269 op/s 2026-02-20T02:46:20.814 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:20 trial098 ceph-mon[38923]: pgmap v671: 129 pgs: 129 active+clean; 448 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.1 MiB/s wr, 269 op/s 2026-02-20T02:46:21.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33263462 4687.96 MB/sec execute 264 sec latency 3.691 ms 2026-02-20T02:46:21.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 89808 12.54 MB/sec execute 264 sec latency 47.550 ms 2026-02-20T02:46:22.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33357466 4689.38 MB/sec execute 265 sec latency 2.879 ms 2026-02-20T02:46:22.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 90058 12.53 MB/sec execute 265 sec latency 60.637 ms 2026-02-20T02:46:23.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:22 trial098 ceph-mon[38923]: pgmap v672: 129 pgs: 129 active+clean; 432 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 216 op/s 2026-02-20T02:46:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:22 trial106 ceph-mon[44052]: pgmap v672: 129 pgs: 129 active+clean; 432 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 216 op/s 2026-02-20T02:46:23.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33447260 4690.09 MB/sec execute 266 sec latency 32.714 ms 2026-02-20T02:46:23.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 90313 12.53 MB/sec execute 266 sec latency 50.341 ms 2026-02-20T02:46:24.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33541597 4691.96 MB/sec execute 267 sec latency 2.503 ms 2026-02-20T02:46:24.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 90571 12.53 MB/sec execute 267 sec latency 39.817 ms 2026-02-20T02:46:25.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:24 trial098 ceph-mon[38923]: pgmap v673: 129 pgs: 129 active+clean; 431 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 6.7 MiB/s wr, 266 op/s 2026-02-20T02:46:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:24 trial106 ceph-mon[44052]: pgmap v673: 129 pgs: 129 active+clean; 431 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 6.7 MiB/s wr, 266 op/s 2026-02-20T02:46:25.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33568022 4679.82 MB/sec execute 268 sec latency 90.034 ms 2026-02-20T02:46:25.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 90738 12.50 MB/sec execute 268 sec latency 108.232 ms 2026-02-20T02:46:26.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33612544 4671.32 MB/sec execute 269 sec latency 83.010 ms 2026-02-20T02:46:26.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 90937 12.47 MB/sec execute 269 sec latency 135.562 ms 2026-02-20T02:46:27.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:26 trial098 ceph-mon[38923]: pgmap v674: 129 pgs: 129 active+clean; 424 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 6.1 MiB/s wr, 235 op/s 2026-02-20T02:46:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:26 trial106 ceph-mon[44052]: pgmap v674: 129 pgs: 129 active+clean; 424 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 6.1 MiB/s wr, 235 op/s 2026-02-20T02:46:27.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33708423 4673.23 MB/sec execute 270 sec latency 1.876 ms 2026-02-20T02:46:27.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 91198 12.48 MB/sec execute 270 sec latency 41.989 ms 2026-02-20T02:46:28.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33800529 4674.33 MB/sec execute 271 sec latency 19.682 ms 2026-02-20T02:46:28.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 91496 12.51 MB/sec execute 271 sec latency 48.377 ms 2026-02-20T02:46:29.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:28 trial098 ceph-mon[38923]: pgmap v675: 129 pgs: 129 active+clean; 423 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 255 op/s 2026-02-20T02:46:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:28 trial106 ceph-mon[44052]: pgmap v675: 129 pgs: 129 active+clean; 423 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 255 op/s 2026-02-20T02:46:29.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33895478 4676.02 MB/sec execute 272 sec latency 3.136 ms 2026-02-20T02:46:29.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 91797 12.56 MB/sec execute 272 sec latency 44.222 ms 2026-02-20T02:46:30.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 33989287 4677.88 MB/sec execute 273 sec latency 2.192 ms 2026-02-20T02:46:30.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 92107 12.60 MB/sec execute 273 sec latency 45.033 ms 2026-02-20T02:46:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:30 trial098 ceph-mon[38923]: pgmap v676: 129 pgs: 129 active+clean; 424 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.3 MiB/s wr, 253 op/s 2026-02-20T02:46:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:46:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:46:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:30 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:46:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:30 trial106 ceph-mon[44052]: pgmap v676: 129 pgs: 129 active+clean; 424 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.3 MiB/s wr, 253 op/s 2026-02-20T02:46:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:46:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:46:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:30 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:46:31.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34082474 4679.18 MB/sec execute 274 sec latency 2.890 ms 2026-02-20T02:46:31.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 92298 12.60 MB/sec execute 274 sec latency 45.196 ms 2026-02-20T02:46:32.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:46:32.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:46:32.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:46:32.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:46:32.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:46:32.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:46:32.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34176592 4680.68 MB/sec execute 275 sec latency 4.850 ms 2026-02-20T02:46:32.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 92503 12.61 MB/sec execute 275 sec latency 60.670 ms 2026-02-20T02:46:33.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:32 trial098 ceph-mon[38923]: pgmap v677: 129 pgs: 129 active+clean; 434 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 250 op/s 2026-02-20T02:46:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:32 trial106 ceph-mon[44052]: pgmap v677: 129 pgs: 129 active+clean; 434 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 250 op/s 2026-02-20T02:46:33.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34271557 4682.26 MB/sec execute 276 sec latency 1.819 ms 2026-02-20T02:46:33.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 92711 12.60 MB/sec execute 276 sec latency 66.034 ms 2026-02-20T02:46:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:46:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:46:34.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34366180 4683.90 MB/sec execute 277 sec latency 3.145 ms 2026-02-20T02:46:34.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 92904 12.58 MB/sec execute 277 sec latency 67.072 ms 2026-02-20T02:46:35.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:34 trial098 ceph-mon[38923]: pgmap v678: 129 pgs: 129 active+clean; 445 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.2 MiB/s wr, 289 op/s 2026-02-20T02:46:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:34 trial106 ceph-mon[44052]: pgmap v678: 129 pgs: 129 active+clean; 445 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.2 MiB/s wr, 289 op/s 2026-02-20T02:46:35.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34460025 4685.61 MB/sec execute 278 sec latency 3.579 ms 2026-02-20T02:46:35.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 93097 12.55 MB/sec execute 278 sec latency 57.018 ms 2026-02-20T02:46:36.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34553385 4686.94 MB/sec execute 279 sec latency 2.783 ms 2026-02-20T02:46:36.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 93346 12.55 MB/sec execute 279 sec latency 44.841 ms 2026-02-20T02:46:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:36 trial106 ceph-mon[44052]: pgmap v679: 129 pgs: 129 active+clean; 451 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 235 op/s 2026-02-20T02:46:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:36 trial098 ceph-mon[38923]: pgmap v679: 129 pgs: 129 active+clean; 451 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 235 op/s 2026-02-20T02:46:37.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34646917 4688.27 MB/sec execute 280 sec latency 3.851 ms 2026-02-20T02:46:37.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 93589 12.54 MB/sec execute 280 sec latency 48.515 ms 2026-02-20T02:46:38.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34739059 4689.26 MB/sec execute 281 sec latency 27.967 ms 2026-02-20T02:46:38.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 93836 12.54 MB/sec execute 281 sec latency 49.607 ms 2026-02-20T02:46:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:38 trial098 ceph-mon[38923]: pgmap v680: 129 pgs: 129 active+clean; 450 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 235 op/s 2026-02-20T02:46:39.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:38 trial106 ceph-mon[44052]: pgmap v680: 129 pgs: 129 active+clean; 450 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 235 op/s 2026-02-20T02:46:39.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34833782 4690.84 MB/sec execute 282 sec latency 4.229 ms 2026-02-20T02:46:39.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 94092 12.54 MB/sec execute 282 sec latency 42.596 ms 2026-02-20T02:46:40.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 34925218 4692.06 MB/sec execute 283 sec latency 17.818 ms 2026-02-20T02:46:40.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 94349 12.52 MB/sec execute 283 sec latency 63.318 ms 2026-02-20T02:46:41.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:40 trial098 ceph-mon[38923]: pgmap v681: 129 pgs: 129 active+clean; 444 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.2 MiB/s wr, 219 op/s 2026-02-20T02:46:41.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:40 trial106 ceph-mon[44052]: pgmap v681: 129 pgs: 129 active+clean; 444 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.2 MiB/s wr, 219 op/s 2026-02-20T02:46:41.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 35020349 4693.67 MB/sec execute 284 sec latency 3.750 ms 2026-02-20T02:46:41.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 94600 12.51 MB/sec execute 284 sec latency 39.163 ms 2026-02-20T02:46:42.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 35037862 4680.50 MB/sec execute 285 sec latency 96.102 ms 2026-02-20T02:46:42.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 94746 12.50 MB/sec execute 285 sec latency 129.604 ms 2026-02-20T02:46:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:42 trial098 ceph-mon[38923]: pgmap v682: 129 pgs: 129 active+clean; 439 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 268 op/s 2026-02-20T02:46:43.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:42 trial106 ceph-mon[44052]: pgmap v682: 129 pgs: 129 active+clean; 439 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 268 op/s 2026-02-20T02:46:43.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 35083426 4672.81 MB/sec execute 286 sec latency 85.434 ms 2026-02-20T02:46:43.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 94947 12.50 MB/sec execute 286 sec latency 140.410 ms 2026-02-20T02:46:44.512 INFO:tasks.workunit.client.0.trial098.stdout: 10 35178400 4674.36 MB/sec execute 287 sec latency 2.386 ms 2026-02-20T02:46:44.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 95243 12.54 MB/sec execute 287 sec latency 43.588 ms 2026-02-20T02:46:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:44 trial098 ceph-mon[38923]: pgmap v683: 129 pgs: 129 active+clean; 436 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 261 op/s 2026-02-20T02:46:45.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:44 trial106 ceph-mon[44052]: pgmap v683: 129 pgs: 129 active+clean; 436 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 261 op/s 2026-02-20T02:46:45.512 INFO:tasks.workunit.client.0.trial098.stdout: 10 35271480 4675.63 MB/sec execute 288 sec latency 3.411 ms 2026-02-20T02:46:45.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 95571 12.59 MB/sec execute 288 sec latency 45.634 ms 2026-02-20T02:46:46.511 INFO:tasks.workunit.client.0.trial098.stdout: 10 35364458 4677.15 MB/sec execute 289 sec latency 10.637 ms 2026-02-20T02:46:46.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 95790 12.60 MB/sec execute 289 sec latency 47.668 ms 2026-02-20T02:46:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:46 trial106 ceph-mon[44052]: pgmap v684: 129 pgs: 129 active+clean; 448 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.4 MiB/s wr, 254 op/s 2026-02-20T02:46:47.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:46 trial098 ceph-mon[38923]: pgmap v684: 129 pgs: 129 active+clean; 448 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.4 MiB/s wr, 254 op/s 2026-02-20T02:46:47.512 INFO:tasks.workunit.client.0.trial098.stdout: 10 35458191 4678.51 MB/sec execute 290 sec latency 2.361 ms 2026-02-20T02:46:47.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 95981 12.60 MB/sec execute 290 sec latency 49.199 ms 2026-02-20T02:46:48.512 INFO:tasks.workunit.client.0.trial098.stdout: 10 35536311 4676.98 MB/sec execute 291 sec latency 89.223 ms 2026-02-20T02:46:48.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 96192 12.61 MB/sec execute 291 sec latency 118.096 ms 2026-02-20T02:46:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:48 trial098 ceph-mon[38923]: pgmap v685: 129 pgs: 129 active+clean; 449 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 262 op/s 2026-02-20T02:46:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:46:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:48 trial106 ceph-mon[44052]: pgmap v685: 129 pgs: 129 active+clean; 449 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 262 op/s 2026-02-20T02:46:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:46:49.512 INFO:tasks.workunit.client.0.trial098.stdout: 10 35598528 4672.45 MB/sec execute 292 sec latency 66.640 ms 2026-02-20T02:46:49.514 INFO:tasks.workunit.client.1.trial106.stdout: 10 96339 12.58 MB/sec execute 292 sec latency 138.835 ms 2026-02-20T02:46:50.512 INFO:tasks.workunit.client.0.trial098.stdout: 10 35692903 4673.86 MB/sec execute 293 sec latency 2.887 ms 2026-02-20T02:46:50.515 INFO:tasks.workunit.client.1.trial106.stdout: 10 96529 12.55 MB/sec execute 293 sec latency 47.679 ms 2026-02-20T02:46:51.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:50 trial098 ceph-mon[38923]: pgmap v686: 129 pgs: 129 active+clean; 437 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 5.7 MiB/s wr, 248 op/s 2026-02-20T02:46:51.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:50 trial106 ceph-mon[44052]: pgmap v686: 129 pgs: 129 active+clean; 437 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 5.7 MiB/s wr, 248 op/s 2026-02-20T02:46:51.512 INFO:tasks.workunit.client.0.trial098.stdout: 10 35786594 4675.52 MB/sec execute 294 sec latency 1.954 ms 2026-02-20T02:46:51.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 96747 12.53 MB/sec execute 294 sec latency 55.920 ms 2026-02-20T02:46:52.512 INFO:tasks.workunit.client.0.trial098.stdout: 10 35878886 4676.69 MB/sec execute 295 sec latency 4.041 ms 2026-02-20T02:46:52.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 97009 12.52 MB/sec execute 295 sec latency 54.409 ms 2026-02-20T02:46:53.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:52 trial098 ceph-mon[38923]: pgmap v687: 129 pgs: 129 active+clean; 432 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 236 op/s 2026-02-20T02:46:53.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:52 trial106 ceph-mon[44052]: pgmap v687: 129 pgs: 129 active+clean; 432 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 236 op/s 2026-02-20T02:46:53.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 35973329 4678.12 MB/sec execute 296 sec latency 3.019 ms 2026-02-20T02:46:53.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 97272 12.53 MB/sec execute 296 sec latency 41.802 ms 2026-02-20T02:46:54.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36026455 4672.04 MB/sec execute 297 sec latency 119.696 ms 2026-02-20T02:46:54.515 INFO:tasks.workunit.client.1.trial106.stdout: 10 97471 12.52 MB/sec execute 297 sec latency 107.026 ms 2026-02-20T02:46:55.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:54 trial098 ceph-mon[38923]: pgmap v688: 129 pgs: 129 active+clean; 428 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.1 MiB/s wr, 205 op/s 2026-02-20T02:46:55.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:54 trial106 ceph-mon[44052]: pgmap v688: 129 pgs: 129 active+clean; 428 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.1 MiB/s wr, 205 op/s 2026-02-20T02:46:55.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36121101 4673.45 MB/sec execute 298 sec latency 9.363 ms 2026-02-20T02:46:55.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 97721 12.52 MB/sec execute 298 sec latency 40.565 ms 2026-02-20T02:46:56.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36215240 4674.96 MB/sec execute 299 sec latency 15.940 ms 2026-02-20T02:46:56.515 INFO:tasks.workunit.client.1.trial106.stdout: 10 97990 12.50 MB/sec execute 299 sec latency 41.349 ms 2026-02-20T02:46:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:56 trial106 ceph-mon[44052]: pgmap v689: 129 pgs: 129 active+clean; 422 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 252 op/s 2026-02-20T02:46:57.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:56 trial098 ceph-mon[38923]: pgmap v689: 129 pgs: 129 active+clean; 422 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 252 op/s 2026-02-20T02:46:57.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36308334 4676.41 MB/sec execute 300 sec latency 4.151 ms 2026-02-20T02:46:57.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 98245 12.50 MB/sec execute 300 sec latency 37.630 ms 2026-02-20T02:46:58.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36398672 4677.09 MB/sec execute 301 sec latency 3.465 ms 2026-02-20T02:46:58.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 98553 12.53 MB/sec execute 301 sec latency 46.452 ms 2026-02-20T02:46:58.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:46:58 trial106 ceph-mon[44052]: pgmap v690: 129 pgs: 129 active+clean; 420 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 227 op/s 2026-02-20T02:46:58.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:46:58 trial098 ceph-mon[38923]: pgmap v690: 129 pgs: 129 active+clean; 420 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 227 op/s 2026-02-20T02:46:59.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36489826 4677.97 MB/sec execute 302 sec latency 18.884 ms 2026-02-20T02:46:59.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 98797 12.54 MB/sec execute 302 sec latency 56.798 ms 2026-02-20T02:47:00.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36534738 4670.50 MB/sec execute 303 sec latency 111.920 ms 2026-02-20T02:47:00.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 99007 12.57 MB/sec execute 303 sec latency 144.830 ms 2026-02-20T02:47:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:00 trial098 ceph-mon[38923]: pgmap v691: 129 pgs: 129 active+clean; 422 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.1 MiB/s wr, 233 op/s 2026-02-20T02:47:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:00 trial106 ceph-mon[44052]: pgmap v691: 129 pgs: 129 active+clean; 422 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.1 MiB/s wr, 233 op/s 2026-02-20T02:47:01.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36628650 4671.87 MB/sec execute 304 sec latency 3.273 ms 2026-02-20T02:47:01.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 99311 12.60 MB/sec execute 304 sec latency 51.587 ms 2026-02-20T02:47:02.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36721999 4673.42 MB/sec execute 305 sec latency 4.492 ms 2026-02-20T02:47:02.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 99467 12.58 MB/sec execute 305 sec latency 43.293 ms 2026-02-20T02:47:03.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:02 trial098 ceph-mon[38923]: pgmap v692: 129 pgs: 129 active+clean; 435 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 276 op/s 2026-02-20T02:47:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:02 trial106 ceph-mon[44052]: pgmap v692: 129 pgs: 129 active+clean; 435 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 276 op/s 2026-02-20T02:47:03.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36815904 4674.75 MB/sec execute 306 sec latency 3.355 ms 2026-02-20T02:47:03.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 99702 12.61 MB/sec execute 306 sec latency 59.293 ms 2026-02-20T02:47:04.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:47:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:47:04.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36907336 4675.63 MB/sec execute 307 sec latency 29.538 ms 2026-02-20T02:47:04.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 99902 12.59 MB/sec execute 307 sec latency 48.935 ms 2026-02-20T02:47:05.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:04 trial098 ceph-mon[38923]: pgmap v693: 129 pgs: 129 active+clean; 444 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 268 op/s 2026-02-20T02:47:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:04 trial106 ceph-mon[44052]: pgmap v693: 129 pgs: 129 active+clean; 444 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 268 op/s 2026-02-20T02:47:05.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 36975379 4672.36 MB/sec execute 308 sec latency 85.987 ms 2026-02-20T02:47:05.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 100062 12.56 MB/sec execute 308 sec latency 94.918 ms 2026-02-20T02:47:06.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37053053 4670.80 MB/sec execute 309 sec latency 57.512 ms 2026-02-20T02:47:06.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 100239 12.53 MB/sec execute 309 sec latency 126.770 ms 2026-02-20T02:47:07.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:06 trial098 ceph-mon[38923]: pgmap v694: 129 pgs: 129 active+clean; 445 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 5.9 MiB/s wr, 242 op/s 2026-02-20T02:47:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:06 trial106 ceph-mon[44052]: pgmap v694: 129 pgs: 129 active+clean; 445 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 5.9 MiB/s wr, 242 op/s 2026-02-20T02:47:07.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37145783 4672.03 MB/sec execute 310 sec latency 3.832 ms 2026-02-20T02:47:07.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 100490 12.53 MB/sec execute 310 sec latency 59.178 ms 2026-02-20T02:47:08.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37239854 4673.59 MB/sec execute 311 sec latency 4.447 ms 2026-02-20T02:47:08.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 100744 12.53 MB/sec execute 311 sec latency 50.750 ms 2026-02-20T02:47:09.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:08 trial098 ceph-mon[38923]: pgmap v695: 129 pgs: 129 active+clean; 446 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 218 op/s 2026-02-20T02:47:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:08 trial106 ceph-mon[44052]: pgmap v695: 129 pgs: 129 active+clean; 446 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 218 op/s 2026-02-20T02:47:09.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37329285 4674.10 MB/sec execute 312 sec latency 28.011 ms 2026-02-20T02:47:09.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 100995 12.53 MB/sec execute 312 sec latency 58.327 ms 2026-02-20T02:47:10.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37423482 4675.45 MB/sec execute 313 sec latency 2.522 ms 2026-02-20T02:47:10.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 101252 12.53 MB/sec execute 313 sec latency 40.186 ms 2026-02-20T02:47:11.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:10 trial098 ceph-mon[38923]: pgmap v696: 129 pgs: 129 active+clean; 446 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 249 op/s 2026-02-20T02:47:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:10 trial106 ceph-mon[44052]: pgmap v696: 129 pgs: 129 active+clean; 446 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 249 op/s 2026-02-20T02:47:11.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37479540 4670.17 MB/sec execute 314 sec latency 69.377 ms 2026-02-20T02:47:11.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 101458 12.51 MB/sec execute 314 sec latency 94.401 ms 2026-02-20T02:47:12.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 37574271 4671.68 MB/sec execute 315 sec latency 3.147 ms 2026-02-20T02:47:12.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 101709 12.49 MB/sec execute 315 sec latency 47.527 ms 2026-02-20T02:47:13.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:12 trial098 ceph-mon[38923]: pgmap v697: 129 pgs: 129 active+clean; 440 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 262 op/s 2026-02-20T02:47:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:12 trial106 ceph-mon[44052]: pgmap v697: 129 pgs: 129 active+clean; 440 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 262 op/s 2026-02-20T02:47:13.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37667655 4673.16 MB/sec execute 316 sec latency 3.763 ms 2026-02-20T02:47:13.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 101985 12.51 MB/sec execute 316 sec latency 44.299 ms 2026-02-20T02:47:14.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37762251 4674.56 MB/sec execute 317 sec latency 3.820 ms 2026-02-20T02:47:14.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 102290 12.54 MB/sec execute 317 sec latency 47.724 ms 2026-02-20T02:47:15.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:14 trial098 ceph-mon[38923]: pgmap v698: 129 pgs: 129 active+clean; 435 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 241 op/s 2026-02-20T02:47:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:14 trial106 ceph-mon[44052]: pgmap v698: 129 pgs: 129 active+clean; 435 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 241 op/s 2026-02-20T02:47:15.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37856769 4675.91 MB/sec execute 318 sec latency 2.800 ms 2026-02-20T02:47:15.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 102585 12.58 MB/sec execute 318 sec latency 45.773 ms 2026-02-20T02:47:16.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 37948428 4676.76 MB/sec execute 319 sec latency 16.879 ms 2026-02-20T02:47:16.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 102866 12.61 MB/sec execute 319 sec latency 55.429 ms 2026-02-20T02:47:17.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:16 trial098 ceph-mon[38923]: pgmap v699: 129 pgs: 129 active+clean; 440 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 245 op/s 2026-02-20T02:47:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:16 trial106 ceph-mon[44052]: pgmap v699: 129 pgs: 129 active+clean; 440 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 245 op/s 2026-02-20T02:47:17.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 38001503 4671.15 MB/sec execute 320 sec latency 86.376 ms 2026-02-20T02:47:17.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 102982 12.59 MB/sec execute 320 sec latency 118.188 ms 2026-02-20T02:47:18.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 38095836 4672.75 MB/sec execute 321 sec latency 3.008 ms 2026-02-20T02:47:18.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 103202 12.61 MB/sec execute 321 sec latency 52.217 ms 2026-02-20T02:47:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:18 trial098 ceph-mon[38923]: pgmap v700: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 259 op/s 2026-02-20T02:47:19.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:47:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:18 trial106 ceph-mon[44052]: pgmap v700: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 259 op/s 2026-02-20T02:47:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:47:19.513 INFO:tasks.workunit.client.0.trial098.stdout: 10 38188263 4673.83 MB/sec execute 322 sec latency 29.869 ms 2026-02-20T02:47:19.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 103408 12.59 MB/sec execute 322 sec latency 56.526 ms 2026-02-20T02:47:20.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 38282847 4675.19 MB/sec execute 323 sec latency 3.054 ms 2026-02-20T02:47:20.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 103601 12.57 MB/sec execute 323 sec latency 57.300 ms 2026-02-20T02:47:21.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:20 trial098 ceph-mon[38923]: pgmap v701: 129 pgs: 129 active+clean; 455 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 270 op/s 2026-02-20T02:47:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:20 trial106 ceph-mon[44052]: pgmap v701: 129 pgs: 129 active+clean; 455 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 270 op/s 2026-02-20T02:47:21.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 38375539 4676.20 MB/sec execute 324 sec latency 3.942 ms 2026-02-20T02:47:21.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 103800 12.55 MB/sec execute 324 sec latency 61.037 ms 2026-02-20T02:47:22.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 38470129 4677.52 MB/sec execute 325 sec latency 1.791 ms 2026-02-20T02:47:22.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 104057 12.54 MB/sec execute 325 sec latency 51.570 ms 2026-02-20T02:47:23.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:22 trial098 ceph-mon[38923]: pgmap v702: 129 pgs: 129 active+clean; 434 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 228 op/s 2026-02-20T02:47:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:22 trial106 ceph-mon[44052]: pgmap v702: 129 pgs: 129 active+clean; 434 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 228 op/s 2026-02-20T02:47:23.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 38561115 4678.62 MB/sec execute 326 sec latency 3.201 ms 2026-02-20T02:47:23.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 104310 12.54 MB/sec execute 326 sec latency 49.142 ms 2026-02-20T02:47:24.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 38649825 4678.96 MB/sec execute 327 sec latency 25.033 ms 2026-02-20T02:47:24.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 104555 12.54 MB/sec execute 327 sec latency 58.263 ms 2026-02-20T02:47:25.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:24 trial098 ceph-mon[38923]: pgmap v703: 129 pgs: 129 active+clean; 429 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 198 op/s 2026-02-20T02:47:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:24 trial106 ceph-mon[44052]: pgmap v703: 129 pgs: 129 active+clean; 429 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 198 op/s 2026-02-20T02:47:25.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 38744009 4680.26 MB/sec execute 328 sec latency 2.864 ms 2026-02-20T02:47:25.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 104820 12.54 MB/sec execute 328 sec latency 49.521 ms 2026-02-20T02:47:26.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 38838565 4681.53 MB/sec execute 329 sec latency 2.618 ms 2026-02-20T02:47:26.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 105076 12.53 MB/sec execute 329 sec latency 40.424 ms 2026-02-20T02:47:27.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:26 trial098 ceph-mon[38923]: pgmap v704: 129 pgs: 129 active+clean; 425 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 245 op/s 2026-02-20T02:47:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:26 trial106 ceph-mon[44052]: pgmap v704: 129 pgs: 129 active+clean; 425 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 245 op/s 2026-02-20T02:47:27.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 38923567 4681.25 MB/sec execute 330 sec latency 99.362 ms 2026-02-20T02:47:27.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 105297 12.51 MB/sec execute 330 sec latency 98.719 ms 2026-02-20T02:47:28.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39017760 4682.76 MB/sec execute 331 sec latency 5.187 ms 2026-02-20T02:47:28.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 105615 12.54 MB/sec execute 331 sec latency 40.336 ms 2026-02-20T02:47:29.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:28 trial098 ceph-mon[38923]: pgmap v705: 129 pgs: 129 active+clean; 424 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 280 op/s 2026-02-20T02:47:29.116 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:28 trial106 ceph-mon[44052]: pgmap v705: 129 pgs: 129 active+clean; 424 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 280 op/s 2026-02-20T02:47:29.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39109009 4683.59 MB/sec execute 332 sec latency 29.112 ms 2026-02-20T02:47:29.516 INFO:tasks.workunit.client.1.trial106.stdout: 10 105872 12.56 MB/sec execute 332 sec latency 54.268 ms 2026-02-20T02:47:30.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39203701 4684.91 MB/sec execute 333 sec latency 2.100 ms 2026-02-20T02:47:30.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 106173 12.60 MB/sec execute 333 sec latency 37.555 ms 2026-02-20T02:47:31.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:30 trial098 ceph-mon[38923]: pgmap v706: 129 pgs: 129 active+clean; 425 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 279 op/s 2026-02-20T02:47:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:30 trial106 ceph-mon[44052]: pgmap v706: 129 pgs: 129 active+clean; 425 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 279 op/s 2026-02-20T02:47:31.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39295790 4685.73 MB/sec execute 334 sec latency 14.920 ms 2026-02-20T02:47:31.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 106442 12.62 MB/sec execute 334 sec latency 70.255 ms 2026-02-20T02:47:31.829 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:47:31.829 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:31.829 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:31 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:32.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:47:32.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:32.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:31 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:32.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39374317 4684.36 MB/sec execute 335 sec latency 79.288 ms 2026-02-20T02:47:32.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 106578 12.60 MB/sec execute 335 sec latency 84.685 ms 2026-02-20T02:47:33.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:32 trial098 ceph-mon[38923]: pgmap v707: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 242 op/s 2026-02-20T02:47:33.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:33.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:33.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:47:33.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:47:33.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:32 trial106 ceph-mon[44052]: pgmap v707: 129 pgs: 129 active+clean; 430 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 242 op/s 2026-02-20T02:47:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:47:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:47:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:47:33.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39376172 4670.74 MB/sec execute 336 sec latency 88.516 ms 2026-02-20T02:47:33.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 106679 12.60 MB/sec execute 336 sec latency 132.522 ms 2026-02-20T02:47:34.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:47:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:47:34.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39460436 4670.66 MB/sec execute 337 sec latency 54.546 ms 2026-02-20T02:47:34.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 106879 12.59 MB/sec execute 337 sec latency 139.815 ms 2026-02-20T02:47:35.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:34 trial098 ceph-mon[38923]: pgmap v708: 129 pgs: 129 active+clean; 443 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 258 op/s 2026-02-20T02:47:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:34 trial106 ceph-mon[44052]: pgmap v708: 129 pgs: 129 active+clean; 443 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 258 op/s 2026-02-20T02:47:35.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39554368 4671.97 MB/sec execute 338 sec latency 8.591 ms 2026-02-20T02:47:35.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 107085 12.58 MB/sec execute 338 sec latency 49.592 ms 2026-02-20T02:47:36.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39649315 4673.35 MB/sec execute 339 sec latency 4.516 ms 2026-02-20T02:47:36.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 107280 12.55 MB/sec execute 339 sec latency 58.235 ms 2026-02-20T02:47:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:36 trial106 ceph-mon[44052]: pgmap v709: 129 pgs: 129 active+clean; 448 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 6.3 MiB/s wr, 276 op/s 2026-02-20T02:47:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:36 trial098 ceph-mon[38923]: pgmap v709: 129 pgs: 129 active+clean; 448 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 6.3 MiB/s wr, 276 op/s 2026-02-20T02:47:37.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39743800 4674.60 MB/sec execute 340 sec latency 4.851 ms 2026-02-20T02:47:37.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 107503 12.55 MB/sec execute 340 sec latency 59.279 ms 2026-02-20T02:47:38.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39837942 4675.82 MB/sec execute 341 sec latency 4.185 ms 2026-02-20T02:47:38.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 107770 12.54 MB/sec execute 341 sec latency 45.898 ms 2026-02-20T02:47:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:38 trial106 ceph-mon[44052]: pgmap v710: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2026-02-20T02:47:39.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:38 trial098 ceph-mon[38923]: pgmap v710: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2026-02-20T02:47:39.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 39932030 4677.26 MB/sec execute 342 sec latency 4.396 ms 2026-02-20T02:47:39.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 108010 12.53 MB/sec execute 342 sec latency 49.418 ms 2026-02-20T02:47:40.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40024120 4678.20 MB/sec execute 343 sec latency 25.579 ms 2026-02-20T02:47:40.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 108275 12.55 MB/sec execute 343 sec latency 44.222 ms 2026-02-20T02:47:41.051 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:40 trial098 ceph-mon[38923]: pgmap v711: 129 pgs: 129 active+clean; 449 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.2 MiB/s wr, 226 op/s 2026-02-20T02:47:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:40 trial106 ceph-mon[44052]: pgmap v711: 129 pgs: 129 active+clean; 449 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.2 MiB/s wr, 226 op/s 2026-02-20T02:47:41.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40119255 4679.57 MB/sec execute 344 sec latency 3.174 ms 2026-02-20T02:47:41.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 108548 12.53 MB/sec execute 344 sec latency 46.968 ms 2026-02-20T02:47:42.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40213925 4680.82 MB/sec execute 345 sec latency 8.400 ms 2026-02-20T02:47:42.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 108774 12.51 MB/sec execute 345 sec latency 37.710 ms 2026-02-20T02:47:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:42 trial106 ceph-mon[44052]: pgmap v712: 129 pgs: 129 active+clean; 443 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 231 op/s 2026-02-20T02:47:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:42 trial098 ceph-mon[38923]: pgmap v712: 129 pgs: 129 active+clean; 443 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 231 op/s 2026-02-20T02:47:43.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40309012 4682.13 MB/sec execute 346 sec latency 2.870 ms 2026-02-20T02:47:43.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 109077 12.54 MB/sec execute 346 sec latency 41.116 ms 2026-02-20T02:47:44.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40403405 4683.64 MB/sec execute 347 sec latency 3.317 ms 2026-02-20T02:47:44.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 109360 12.56 MB/sec execute 347 sec latency 51.233 ms 2026-02-20T02:47:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:44 trial106 ceph-mon[44052]: pgmap v713: 129 pgs: 129 active+clean; 435 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.9 MiB/s wr, 243 op/s 2026-02-20T02:47:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:44 trial098 ceph-mon[38923]: pgmap v713: 129 pgs: 129 active+clean; 435 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.9 MiB/s wr, 243 op/s 2026-02-20T02:47:45.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40497580 4684.84 MB/sec execute 348 sec latency 2.454 ms 2026-02-20T02:47:45.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 109629 12.58 MB/sec execute 348 sec latency 41.118 ms 2026-02-20T02:47:46.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40591465 4685.95 MB/sec execute 349 sec latency 5.822 ms 2026-02-20T02:47:46.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 109938 12.61 MB/sec execute 349 sec latency 55.118 ms 2026-02-20T02:47:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:46 trial106 ceph-mon[44052]: pgmap v714: 129 pgs: 129 active+clean; 443 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.2 MiB/s wr, 275 op/s 2026-02-20T02:47:47.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:46 trial098 ceph-mon[38923]: pgmap v714: 129 pgs: 129 active+clean; 443 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.2 MiB/s wr, 275 op/s 2026-02-20T02:47:47.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40685768 4687.08 MB/sec execute 350 sec latency 4.022 ms 2026-02-20T02:47:47.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 110115 12.61 MB/sec execute 350 sec latency 51.877 ms 2026-02-20T02:47:48.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 40778870 4688.13 MB/sec execute 351 sec latency 3.750 ms 2026-02-20T02:47:48.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 110323 12.62 MB/sec execute 351 sec latency 49.567 ms 2026-02-20T02:47:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:48 trial106 ceph-mon[44052]: pgmap v715: 129 pgs: 129 active+clean; 450 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 252 op/s 2026-02-20T02:47:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:47:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:48 trial098 ceph-mon[38923]: pgmap v715: 129 pgs: 129 active+clean; 450 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 252 op/s 2026-02-20T02:47:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:47:49.514 INFO:tasks.workunit.client.0.trial098.stdout: 10 40848360 4685.69 MB/sec execute 352 sec latency 100.785 ms 2026-02-20T02:47:49.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 110497 12.61 MB/sec execute 352 sec latency 141.620 ms 2026-02-20T02:47:50.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 40850164 4672.70 MB/sec execute 353 sec latency 115.855 ms 2026-02-20T02:47:50.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 110588 12.58 MB/sec execute 353 sec latency 146.998 ms 2026-02-20T02:47:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:50 trial106 ceph-mon[44052]: pgmap v716: 129 pgs: 129 active+clean; 456 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 265 op/s 2026-02-20T02:47:51.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:50 trial098 ceph-mon[38923]: pgmap v716: 129 pgs: 129 active+clean; 456 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 265 op/s 2026-02-20T02:47:51.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 40922865 4670.63 MB/sec execute 354 sec latency 84.144 ms 2026-02-20T02:47:51.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 110757 12.55 MB/sec execute 354 sec latency 141.501 ms 2026-02-20T02:47:52.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41016095 4671.72 MB/sec execute 355 sec latency 7.622 ms 2026-02-20T02:47:52.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 110964 12.54 MB/sec execute 355 sec latency 57.803 ms 2026-02-20T02:47:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:52 trial106 ceph-mon[44052]: pgmap v717: 129 pgs: 129 active+clean; 436 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 233 op/s 2026-02-20T02:47:53.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:52 trial098 ceph-mon[38923]: pgmap v717: 129 pgs: 129 active+clean; 436 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 233 op/s 2026-02-20T02:47:53.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41110731 4672.93 MB/sec execute 356 sec latency 2.421 ms 2026-02-20T02:47:53.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 111225 12.53 MB/sec execute 356 sec latency 47.211 ms 2026-02-20T02:47:54.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41203978 4673.92 MB/sec execute 357 sec latency 3.374 ms 2026-02-20T02:47:54.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 111461 12.53 MB/sec execute 357 sec latency 53.158 ms 2026-02-20T02:47:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:54 trial106 ceph-mon[44052]: pgmap v718: 129 pgs: 129 active+clean; 430 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 6.3 MiB/s wr, 222 op/s 2026-02-20T02:47:55.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:54 trial098 ceph-mon[38923]: pgmap v718: 129 pgs: 129 active+clean; 430 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 6.3 MiB/s wr, 222 op/s 2026-02-20T02:47:55.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41296518 4675.08 MB/sec execute 358 sec latency 21.167 ms 2026-02-20T02:47:55.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 111716 12.53 MB/sec execute 358 sec latency 45.750 ms 2026-02-20T02:47:56.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41351152 4670.35 MB/sec execute 359 sec latency 68.368 ms 2026-02-20T02:47:56.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 111932 12.53 MB/sec execute 359 sec latency 109.133 ms 2026-02-20T02:47:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:56 trial106 ceph-mon[44052]: pgmap v719: 129 pgs: 129 active+clean; 428 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 6.4 MiB/s wr, 239 op/s 2026-02-20T02:47:57.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:56 trial098 ceph-mon[38923]: pgmap v719: 129 pgs: 129 active+clean; 428 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 6.4 MiB/s wr, 239 op/s 2026-02-20T02:47:57.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41445884 4671.68 MB/sec execute 360 sec latency 3.523 ms 2026-02-20T02:47:57.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 112189 12.51 MB/sec execute 360 sec latency 39.445 ms 2026-02-20T02:47:58.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41540119 4672.80 MB/sec execute 361 sec latency 4.295 ms 2026-02-20T02:47:58.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 112437 12.51 MB/sec execute 361 sec latency 39.416 ms 2026-02-20T02:47:59.117 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:47:58 trial098 ceph-mon[38923]: pgmap v720: 129 pgs: 129 active+clean; 428 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 233 op/s 2026-02-20T02:47:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:47:58 trial106 ceph-mon[44052]: pgmap v720: 129 pgs: 129 active+clean; 428 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 233 op/s 2026-02-20T02:47:59.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41634753 4673.99 MB/sec execute 362 sec latency 4.252 ms 2026-02-20T02:47:59.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 112765 12.53 MB/sec execute 362 sec latency 37.962 ms 2026-02-20T02:48:00.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41727140 4674.93 MB/sec execute 363 sec latency 14.244 ms 2026-02-20T02:48:00.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 113006 12.55 MB/sec execute 363 sec latency 45.509 ms 2026-02-20T02:48:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:00 trial106 ceph-mon[44052]: pgmap v721: 129 pgs: 129 active+clean; 424 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.4 MiB/s wr, 240 op/s 2026-02-20T02:48:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:00 trial098 ceph-mon[38923]: pgmap v721: 129 pgs: 129 active+clean; 424 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.4 MiB/s wr, 240 op/s 2026-02-20T02:48:01.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41820375 4676.15 MB/sec execute 364 sec latency 3.844 ms 2026-02-20T02:48:01.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 113329 12.59 MB/sec execute 364 sec latency 39.070 ms 2026-02-20T02:48:02.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41872029 4671.09 MB/sec execute 365 sec latency 70.376 ms 2026-02-20T02:48:02.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 113545 12.60 MB/sec execute 365 sec latency 123.738 ms 2026-02-20T02:48:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:02 trial106 ceph-mon[44052]: pgmap v722: 129 pgs: 129 active+clean; 431 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 266 op/s 2026-02-20T02:48:03.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:02 trial098 ceph-mon[38923]: pgmap v722: 129 pgs: 129 active+clean; 431 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 266 op/s 2026-02-20T02:48:03.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 41966369 4672.23 MB/sec execute 366 sec latency 3.297 ms 2026-02-20T02:48:03.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 113699 12.59 MB/sec execute 366 sec latency 44.256 ms 2026-02-20T02:48:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:48:04.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:48:04.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42060560 4673.30 MB/sec execute 367 sec latency 3.737 ms 2026-02-20T02:48:04.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 113910 12.60 MB/sec execute 367 sec latency 58.162 ms 2026-02-20T02:48:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:04 trial106 ceph-mon[44052]: pgmap v723: 129 pgs: 129 active+clean; 442 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 5.4 MiB/s wr, 243 op/s 2026-02-20T02:48:05.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:04 trial098 ceph-mon[38923]: pgmap v723: 129 pgs: 129 active+clean; 442 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 5.4 MiB/s wr, 243 op/s 2026-02-20T02:48:05.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42155877 4674.68 MB/sec execute 368 sec latency 3.528 ms 2026-02-20T02:48:05.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 114121 12.59 MB/sec execute 368 sec latency 68.734 ms 2026-02-20T02:48:06.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42247842 4675.72 MB/sec execute 369 sec latency 13.105 ms 2026-02-20T02:48:06.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 114320 12.56 MB/sec execute 369 sec latency 46.454 ms 2026-02-20T02:48:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:06 trial106 ceph-mon[44052]: pgmap v724: 129 pgs: 129 active+clean; 449 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 255 op/s 2026-02-20T02:48:07.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:06 trial098 ceph-mon[38923]: pgmap v724: 129 pgs: 129 active+clean; 449 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.0 MiB/s wr, 255 op/s 2026-02-20T02:48:07.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42340364 4676.65 MB/sec execute 370 sec latency 4.056 ms 2026-02-20T02:48:07.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 114527 12.54 MB/sec execute 370 sec latency 53.008 ms 2026-02-20T02:48:08.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42434863 4677.78 MB/sec execute 371 sec latency 1.881 ms 2026-02-20T02:48:08.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 114796 12.55 MB/sec execute 371 sec latency 46.135 ms 2026-02-20T02:48:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:08 trial106 ceph-mon[44052]: pgmap v725: 129 pgs: 129 active+clean; 448 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 249 op/s 2026-02-20T02:48:09.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:08 trial098 ceph-mon[38923]: pgmap v725: 129 pgs: 129 active+clean; 448 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 249 op/s 2026-02-20T02:48:09.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42528038 4678.71 MB/sec execute 372 sec latency 2.721 ms 2026-02-20T02:48:09.517 INFO:tasks.workunit.client.1.trial106.stdout: 10 115033 12.54 MB/sec execute 372 sec latency 49.621 ms 2026-02-20T02:48:10.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42618180 4679.26 MB/sec execute 373 sec latency 39.521 ms 2026-02-20T02:48:10.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 115301 12.55 MB/sec execute 373 sec latency 45.934 ms 2026-02-20T02:48:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:10 trial106 ceph-mon[44052]: pgmap v726: 129 pgs: 129 active+clean; 446 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 210 op/s 2026-02-20T02:48:11.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:10 trial098 ceph-mon[38923]: pgmap v726: 129 pgs: 129 active+clean; 446 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 210 op/s 2026-02-20T02:48:11.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42712805 4680.67 MB/sec execute 374 sec latency 3.461 ms 2026-02-20T02:48:11.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 115576 12.54 MB/sec execute 374 sec latency 38.846 ms 2026-02-20T02:48:12.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42800469 4680.90 MB/sec execute 375 sec latency 71.167 ms 2026-02-20T02:48:12.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 115800 12.53 MB/sec execute 375 sec latency 81.701 ms 2026-02-20T02:48:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:12 trial106 ceph-mon[44052]: pgmap v727: 129 pgs: 129 active+clean; 443 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 251 op/s 2026-02-20T02:48:13.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:12 trial098 ceph-mon[38923]: pgmap v727: 129 pgs: 129 active+clean; 443 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 251 op/s 2026-02-20T02:48:13.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42896047 4682.16 MB/sec execute 376 sec latency 2.669 ms 2026-02-20T02:48:13.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 116067 12.54 MB/sec execute 376 sec latency 46.094 ms 2026-02-20T02:48:14.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 42990080 4683.17 MB/sec execute 377 sec latency 3.522 ms 2026-02-20T02:48:14.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 116402 12.56 MB/sec execute 377 sec latency 43.269 ms 2026-02-20T02:48:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:14 trial106 ceph-mon[44052]: pgmap v728: 129 pgs: 129 active+clean; 442 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.4 MiB/s wr, 265 op/s 2026-02-20T02:48:15.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:14 trial098 ceph-mon[38923]: pgmap v728: 129 pgs: 129 active+clean; 442 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.4 MiB/s wr, 265 op/s 2026-02-20T02:48:15.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 43084724 4684.38 MB/sec execute 378 sec latency 2.348 ms 2026-02-20T02:48:15.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 116632 12.58 MB/sec execute 378 sec latency 41.818 ms 2026-02-20T02:48:16.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43178172 4685.58 MB/sec execute 379 sec latency 1.938 ms 2026-02-20T02:48:16.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 116949 12.62 MB/sec execute 379 sec latency 48.482 ms 2026-02-20T02:48:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:16 trial106 ceph-mon[44052]: pgmap v729: 129 pgs: 129 active+clean; 445 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.7 MiB/s wr, 269 op/s 2026-02-20T02:48:17.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:16 trial098 ceph-mon[38923]: pgmap v729: 129 pgs: 129 active+clean; 445 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.7 MiB/s wr, 269 op/s 2026-02-20T02:48:17.515 INFO:tasks.workunit.client.0.trial098.stdout: 10 43264567 4685.59 MB/sec execute 380 sec latency 70.781 ms 2026-02-20T02:48:17.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 117161 12.62 MB/sec execute 380 sec latency 74.887 ms 2026-02-20T02:48:18.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43265867 4673.48 MB/sec execute 381 sec latency 105.540 ms 2026-02-20T02:48:18.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 117217 12.59 MB/sec execute 381 sec latency 116.238 ms 2026-02-20T02:48:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:18 trial106 ceph-mon[44052]: pgmap v730: 129 pgs: 129 active+clean; 449 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 275 op/s 2026-02-20T02:48:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:48:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:18 trial098 ceph-mon[38923]: pgmap v730: 129 pgs: 129 active+clean; 449 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 275 op/s 2026-02-20T02:48:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:48:19.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43344779 4672.38 MB/sec execute 382 sec latency 56.980 ms 2026-02-20T02:48:19.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 117390 12.59 MB/sec execute 382 sec latency 132.388 ms 2026-02-20T02:48:20.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43437945 4673.30 MB/sec execute 383 sec latency 18.343 ms 2026-02-20T02:48:20.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 117616 12.59 MB/sec execute 383 sec latency 61.053 ms 2026-02-20T02:48:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:20 trial106 ceph-mon[44052]: pgmap v731: 129 pgs: 129 active+clean; 437 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 5.7 MiB/s wr, 247 op/s 2026-02-20T02:48:21.239 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:20 trial098 ceph-mon[38923]: pgmap v731: 129 pgs: 129 active+clean; 437 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 5.7 MiB/s wr, 247 op/s 2026-02-20T02:48:21.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43529240 4674.03 MB/sec execute 384 sec latency 28.073 ms 2026-02-20T02:48:21.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 117813 12.57 MB/sec execute 384 sec latency 45.890 ms 2026-02-20T02:48:22.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43621678 4675.07 MB/sec execute 385 sec latency 2.880 ms 2026-02-20T02:48:22.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 118012 12.55 MB/sec execute 385 sec latency 51.729 ms 2026-02-20T02:48:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:22 trial106 ceph-mon[44052]: pgmap v732: 129 pgs: 129 active+clean; 443 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 286 op/s 2026-02-20T02:48:23.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:22 trial098 ceph-mon[38923]: pgmap v732: 129 pgs: 129 active+clean; 443 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 286 op/s 2026-02-20T02:48:23.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43714545 4676.04 MB/sec execute 386 sec latency 3.107 ms 2026-02-20T02:48:23.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 118260 12.55 MB/sec execute 386 sec latency 67.060 ms 2026-02-20T02:48:24.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43807947 4676.97 MB/sec execute 387 sec latency 2.958 ms 2026-02-20T02:48:24.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 118503 12.54 MB/sec execute 387 sec latency 50.000 ms 2026-02-20T02:48:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:24 trial106 ceph-mon[44052]: pgmap v733: 129 pgs: 129 active+clean; 443 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.3 MiB/s wr, 241 op/s 2026-02-20T02:48:25.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:24 trial098 ceph-mon[38923]: pgmap v733: 129 pgs: 129 active+clean; 443 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.3 MiB/s wr, 241 op/s 2026-02-20T02:48:25.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43902011 4677.98 MB/sec execute 388 sec latency 3.182 ms 2026-02-20T02:48:25.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 118755 12.54 MB/sec execute 388 sec latency 51.834 ms 2026-02-20T02:48:26.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 43994499 4678.89 MB/sec execute 389 sec latency 22.606 ms 2026-02-20T02:48:26.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 119029 12.54 MB/sec execute 389 sec latency 45.793 ms 2026-02-20T02:48:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:26 trial106 ceph-mon[44052]: pgmap v734: 129 pgs: 129 active+clean; 437 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 5.9 MiB/s wr, 201 op/s 2026-02-20T02:48:27.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:26 trial098 ceph-mon[38923]: pgmap v734: 129 pgs: 129 active+clean; 437 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 5.9 MiB/s wr, 201 op/s 2026-02-20T02:48:27.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44088071 4680.08 MB/sec execute 390 sec latency 2.989 ms 2026-02-20T02:48:27.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 119286 12.53 MB/sec execute 390 sec latency 42.332 ms 2026-02-20T02:48:28.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44179137 4680.75 MB/sec execute 391 sec latency 26.813 ms 2026-02-20T02:48:28.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 119514 12.51 MB/sec execute 391 sec latency 47.616 ms 2026-02-20T02:48:29.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:28 trial098 ceph-mon[38923]: pgmap v735: 129 pgs: 129 active+clean; 431 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 238 op/s 2026-02-20T02:48:29.366 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:28 trial106 ceph-mon[44052]: pgmap v735: 129 pgs: 129 active+clean; 431 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 238 op/s 2026-02-20T02:48:29.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44272482 4681.65 MB/sec execute 392 sec latency 2.446 ms 2026-02-20T02:48:29.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 119834 12.56 MB/sec execute 392 sec latency 51.315 ms 2026-02-20T02:48:30.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44366919 4682.69 MB/sec execute 393 sec latency 2.852 ms 2026-02-20T02:48:30.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 120096 12.56 MB/sec execute 393 sec latency 42.273 ms 2026-02-20T02:48:31.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:30 trial098 ceph-mon[38923]: pgmap v736: 129 pgs: 129 active+clean; 432 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.2 MiB/s wr, 254 op/s 2026-02-20T02:48:31.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:30 trial106 ceph-mon[44052]: pgmap v736: 129 pgs: 129 active+clean; 432 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.2 MiB/s wr, 254 op/s 2026-02-20T02:48:31.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44459423 4683.54 MB/sec execute 394 sec latency 5.434 ms 2026-02-20T02:48:31.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 120373 12.59 MB/sec execute 394 sec latency 42.517 ms 2026-02-20T02:48:32.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44553784 4684.81 MB/sec execute 395 sec latency 2.109 ms 2026-02-20T02:48:32.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 120658 12.61 MB/sec execute 395 sec latency 62.314 ms 2026-02-20T02:48:33.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:32 trial098 ceph-mon[38923]: pgmap v737: 129 pgs: 129 active+clean; 438 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 258 op/s 2026-02-20T02:48:33.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:48:33.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:48:33.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:48:33.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:32 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:48:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:32 trial106 ceph-mon[44052]: pgmap v737: 129 pgs: 129 active+clean; 438 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 258 op/s 2026-02-20T02:48:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:48:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:48:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:48:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:32 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:48:33.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44646690 4685.72 MB/sec execute 396 sec latency 4.607 ms 2026-02-20T02:48:33.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 120817 12.60 MB/sec execute 396 sec latency 43.225 ms 2026-02-20T02:48:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:48:34.366 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:48:34.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44722942 4684.28 MB/sec execute 397 sec latency 70.118 ms 2026-02-20T02:48:34.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 121019 12.62 MB/sec execute 397 sec latency 95.057 ms 2026-02-20T02:48:35.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:34 trial098 ceph-mon[38923]: pgmap v738: 129 pgs: 129 active+clean; 446 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 5.4 MiB/s wr, 222 op/s 2026-02-20T02:48:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:34 trial106 ceph-mon[44052]: pgmap v738: 129 pgs: 129 active+clean; 446 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 5.4 MiB/s wr, 222 op/s 2026-02-20T02:48:35.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44724629 4672.74 MB/sec execute 398 sec latency 91.602 ms 2026-02-20T02:48:35.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 121106 12.59 MB/sec execute 398 sec latency 166.321 ms 2026-02-20T02:48:36.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44803214 4671.64 MB/sec execute 399 sec latency 83.182 ms 2026-02-20T02:48:36.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 121287 12.57 MB/sec execute 399 sec latency 122.821 ms 2026-02-20T02:48:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:36 trial106 ceph-mon[44052]: pgmap v739: 129 pgs: 129 active+clean; 456 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 258 op/s 2026-02-20T02:48:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:36 trial098 ceph-mon[38923]: pgmap v739: 129 pgs: 129 active+clean; 456 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 258 op/s 2026-02-20T02:48:37.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44897836 4672.81 MB/sec execute 400 sec latency 3.772 ms 2026-02-20T02:48:37.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 121481 12.55 MB/sec execute 400 sec latency 48.855 ms 2026-02-20T02:48:38.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 44991362 4673.95 MB/sec execute 401 sec latency 3.473 ms 2026-02-20T02:48:38.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 121704 12.53 MB/sec execute 401 sec latency 50.611 ms 2026-02-20T02:48:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:38 trial098 ceph-mon[38923]: pgmap v740: 129 pgs: 129 active+clean; 459 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 257 op/s 2026-02-20T02:48:39.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:38 trial106 ceph-mon[44052]: pgmap v740: 129 pgs: 129 active+clean; 459 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 257 op/s 2026-02-20T02:48:39.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 45085188 4675.02 MB/sec execute 402 sec latency 3.122 ms 2026-02-20T02:48:39.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 121983 12.55 MB/sec execute 402 sec latency 45.133 ms 2026-02-20T02:48:40.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 45178297 4675.87 MB/sec execute 403 sec latency 3.726 ms 2026-02-20T02:48:40.518 INFO:tasks.workunit.client.1.trial106.stdout: 10 122228 12.54 MB/sec execute 403 sec latency 46.644 ms 2026-02-20T02:48:41.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:40 trial098 ceph-mon[38923]: pgmap v741: 129 pgs: 129 active+clean; 456 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2026-02-20T02:48:41.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:40 trial106 ceph-mon[44052]: pgmap v741: 129 pgs: 129 active+clean; 456 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2026-02-20T02:48:41.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 45231618 4671.42 MB/sec execute 404 sec latency 73.812 ms 2026-02-20T02:48:41.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 122454 12.55 MB/sec execute 404 sec latency 119.269 ms 2026-02-20T02:48:42.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 45327113 4672.63 MB/sec execute 405 sec latency 2.315 ms 2026-02-20T02:48:42.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 122703 12.53 MB/sec execute 405 sec latency 42.880 ms 2026-02-20T02:48:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:42 trial098 ceph-mon[38923]: pgmap v742: 129 pgs: 129 active+clean; 452 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 227 op/s 2026-02-20T02:48:43.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:42 trial106 ceph-mon[44052]: pgmap v742: 129 pgs: 129 active+clean; 452 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 227 op/s 2026-02-20T02:48:43.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 45420304 4673.66 MB/sec execute 406 sec latency 13.887 ms 2026-02-20T02:48:43.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 122924 12.51 MB/sec execute 406 sec latency 40.945 ms 2026-02-20T02:48:44.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 45514682 4674.86 MB/sec execute 407 sec latency 2.728 ms 2026-02-20T02:48:44.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 123203 12.53 MB/sec execute 407 sec latency 43.799 ms 2026-02-20T02:48:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:44 trial098 ceph-mon[38923]: pgmap v743: 129 pgs: 129 active+clean; 436 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.9 MiB/s wr, 244 op/s 2026-02-20T02:48:45.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:44 trial106 ceph-mon[44052]: pgmap v743: 129 pgs: 129 active+clean; 436 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.9 MiB/s wr, 244 op/s 2026-02-20T02:48:45.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 45609417 4675.94 MB/sec execute 408 sec latency 6.270 ms 2026-02-20T02:48:45.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 123537 12.55 MB/sec execute 408 sec latency 40.513 ms 2026-02-20T02:48:46.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 45702770 4676.82 MB/sec execute 409 sec latency 16.452 ms 2026-02-20T02:48:46.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 123756 12.56 MB/sec execute 409 sec latency 42.746 ms 2026-02-20T02:48:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:46 trial106 ceph-mon[44052]: pgmap v744: 129 pgs: 129 active+clean; 423 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.4 MiB/s wr, 272 op/s 2026-02-20T02:48:47.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:46 trial098 ceph-mon[38923]: pgmap v744: 129 pgs: 129 active+clean; 423 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.4 MiB/s wr, 272 op/s 2026-02-20T02:48:47.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 45745990 4671.09 MB/sec execute 410 sec latency 127.752 ms 2026-02-20T02:48:47.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 123955 12.57 MB/sec execute 410 sec latency 155.631 ms 2026-02-20T02:48:48.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 45840318 4672.20 MB/sec execute 411 sec latency 2.578 ms 2026-02-20T02:48:48.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 124236 12.59 MB/sec execute 411 sec latency 45.496 ms 2026-02-20T02:48:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:48 trial098 ceph-mon[38923]: pgmap v745: 129 pgs: 129 active+clean; 422 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 232 op/s 2026-02-20T02:48:49.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:48:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:48 trial106 ceph-mon[44052]: pgmap v745: 129 pgs: 129 active+clean; 422 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 232 op/s 2026-02-20T02:48:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:48:49.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 45934601 4673.43 MB/sec execute 412 sec latency 2.843 ms 2026-02-20T02:48:49.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 124400 12.59 MB/sec execute 412 sec latency 56.377 ms 2026-02-20T02:48:50.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46030003 4674.67 MB/sec execute 413 sec latency 3.915 ms 2026-02-20T02:48:50.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 124620 12.59 MB/sec execute 413 sec latency 62.997 ms 2026-02-20T02:48:51.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:50 trial098 ceph-mon[38923]: pgmap v746: 129 pgs: 129 active+clean; 435 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 5.5 MiB/s wr, 263 op/s 2026-02-20T02:48:51.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:50 trial106 ceph-mon[44052]: pgmap v746: 129 pgs: 129 active+clean; 435 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 5.5 MiB/s wr, 263 op/s 2026-02-20T02:48:51.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46123043 4675.48 MB/sec execute 414 sec latency 17.262 ms 2026-02-20T02:48:51.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 124824 12.58 MB/sec execute 414 sec latency 52.562 ms 2026-02-20T02:48:52.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 46189153 4672.81 MB/sec execute 415 sec latency 120.734 ms 2026-02-20T02:48:52.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 124984 12.55 MB/sec execute 415 sec latency 152.243 ms 2026-02-20T02:48:53.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:52 trial098 ceph-mon[38923]: pgmap v747: 129 pgs: 129 active+clean; 438 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 264 op/s 2026-02-20T02:48:53.366 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:52 trial106 ceph-mon[44052]: pgmap v747: 129 pgs: 129 active+clean; 438 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 264 op/s 2026-02-20T02:48:53.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 46257746 4670.51 MB/sec execute 416 sec latency 102.455 ms 2026-02-20T02:48:53.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 125164 12.54 MB/sec execute 416 sec latency 123.908 ms 2026-02-20T02:48:54.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46352145 4671.67 MB/sec execute 417 sec latency 2.482 ms 2026-02-20T02:48:54.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 125432 12.55 MB/sec execute 417 sec latency 55.827 ms 2026-02-20T02:48:55.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:54 trial098 ceph-mon[38923]: pgmap v748: 129 pgs: 129 active+clean; 435 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 5.8 MiB/s wr, 211 op/s 2026-02-20T02:48:55.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:54 trial106 ceph-mon[44052]: pgmap v748: 129 pgs: 129 active+clean; 435 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 5.8 MiB/s wr, 211 op/s 2026-02-20T02:48:55.516 INFO:tasks.workunit.client.0.trial098.stdout: 10 46445852 4672.77 MB/sec execute 418 sec latency 2.684 ms 2026-02-20T02:48:55.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 125672 12.53 MB/sec execute 418 sec latency 43.539 ms 2026-02-20T02:48:56.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46535277 4673.12 MB/sec execute 419 sec latency 4.414 ms 2026-02-20T02:48:56.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 125947 12.54 MB/sec execute 419 sec latency 46.779 ms 2026-02-20T02:48:57.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:56 trial098 ceph-mon[38923]: pgmap v749: 129 pgs: 129 active+clean; 440 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 243 op/s 2026-02-20T02:48:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:56 trial106 ceph-mon[44052]: pgmap v749: 129 pgs: 129 active+clean; 440 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 243 op/s 2026-02-20T02:48:57.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46628806 4673.99 MB/sec execute 420 sec latency 2.629 ms 2026-02-20T02:48:57.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 126208 12.53 MB/sec execute 420 sec latency 42.493 ms 2026-02-20T02:48:58.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46666750 4667.76 MB/sec execute 421 sec latency 145.150 ms 2026-02-20T02:48:58.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 126361 12.52 MB/sec execute 421 sec latency 179.550 ms 2026-02-20T02:48:58.617 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:48:58 trial106 ceph-mon[44052]: pgmap v750: 129 pgs: 129 active+clean; 433 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 223 op/s 2026-02-20T02:48:58.815 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:48:58 trial098 ceph-mon[38923]: pgmap v750: 129 pgs: 129 active+clean; 433 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 223 op/s 2026-02-20T02:48:59.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46761741 4668.93 MB/sec execute 422 sec latency 3.275 ms 2026-02-20T02:48:59.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 126597 12.51 MB/sec execute 422 sec latency 49.376 ms 2026-02-20T02:49:00.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46855712 4670.15 MB/sec execute 423 sec latency 5.059 ms 2026-02-20T02:49:00.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 126906 12.53 MB/sec execute 423 sec latency 44.171 ms 2026-02-20T02:49:01.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:00 trial098 ceph-mon[38923]: pgmap v751: 129 pgs: 129 active+clean; 427 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 234 op/s 2026-02-20T02:49:01.116 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:00 trial106 ceph-mon[44052]: pgmap v751: 129 pgs: 129 active+clean; 427 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 234 op/s 2026-02-20T02:49:01.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 46943172 4670.29 MB/sec execute 424 sec latency 54.722 ms 2026-02-20T02:49:01.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 127181 12.54 MB/sec execute 424 sec latency 66.059 ms 2026-02-20T02:49:02.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47036587 4671.16 MB/sec execute 425 sec latency 2.800 ms 2026-02-20T02:49:02.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 127452 12.57 MB/sec execute 425 sec latency 68.193 ms 2026-02-20T02:49:03.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:02 trial098 ceph-mon[38923]: pgmap v752: 129 pgs: 129 active+clean; 430 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 242 op/s 2026-02-20T02:49:03.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:02 trial106 ceph-mon[44052]: pgmap v752: 129 pgs: 129 active+clean; 430 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 242 op/s 2026-02-20T02:49:03.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47128427 4671.80 MB/sec execute 426 sec latency 13.022 ms 2026-02-20T02:49:03.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 127752 12.59 MB/sec execute 426 sec latency 60.858 ms 2026-02-20T02:49:04.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:49:04.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:49:04.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47165118 4665.54 MB/sec execute 427 sec latency 148.561 ms 2026-02-20T02:49:04.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 127844 12.57 MB/sec execute 427 sec latency 143.185 ms 2026-02-20T02:49:05.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:04 trial098 ceph-mon[38923]: pgmap v753: 129 pgs: 129 active+clean; 439 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2026-02-20T02:49:05.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:04 trial106 ceph-mon[44052]: pgmap v753: 129 pgs: 129 active+clean; 439 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2026-02-20T02:49:05.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47259122 4666.65 MB/sec execute 428 sec latency 3.421 ms 2026-02-20T02:49:05.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 128047 12.58 MB/sec execute 428 sec latency 55.549 ms 2026-02-20T02:49:06.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47352105 4667.61 MB/sec execute 429 sec latency 4.948 ms 2026-02-20T02:49:06.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 128248 12.57 MB/sec execute 429 sec latency 51.487 ms 2026-02-20T02:49:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:06 trial106 ceph-mon[44052]: pgmap v754: 129 pgs: 129 active+clean; 450 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 285 op/s 2026-02-20T02:49:07.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:06 trial098 ceph-mon[38923]: pgmap v754: 129 pgs: 129 active+clean; 450 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 285 op/s 2026-02-20T02:49:07.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47443897 4668.30 MB/sec execute 430 sec latency 27.520 ms 2026-02-20T02:49:07.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 128457 12.56 MB/sec execute 430 sec latency 43.756 ms 2026-02-20T02:49:08.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47537881 4669.22 MB/sec execute 431 sec latency 4.428 ms 2026-02-20T02:49:08.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 128659 12.54 MB/sec execute 431 sec latency 56.643 ms 2026-02-20T02:49:09.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:08 trial106 ceph-mon[44052]: pgmap v755: 129 pgs: 129 active+clean; 453 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 227 op/s 2026-02-20T02:49:09.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:08 trial098 ceph-mon[38923]: pgmap v755: 129 pgs: 129 active+clean; 453 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 227 op/s 2026-02-20T02:49:09.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47630514 4670.02 MB/sec execute 432 sec latency 2.850 ms 2026-02-20T02:49:09.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 128903 12.53 MB/sec execute 432 sec latency 64.013 ms 2026-02-20T02:49:10.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47722288 4670.81 MB/sec execute 433 sec latency 3.959 ms 2026-02-20T02:49:10.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 129153 12.54 MB/sec execute 433 sec latency 49.341 ms 2026-02-20T02:49:11.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:10 trial106 ceph-mon[44052]: pgmap v756: 129 pgs: 129 active+clean; 452 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 5.9 MiB/s wr, 213 op/s 2026-02-20T02:49:11.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:10 trial098 ceph-mon[38923]: pgmap v756: 129 pgs: 129 active+clean; 452 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 5.9 MiB/s wr, 213 op/s 2026-02-20T02:49:11.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47814185 4671.62 MB/sec execute 434 sec latency 3.077 ms 2026-02-20T02:49:11.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 129426 12.55 MB/sec execute 434 sec latency 44.234 ms 2026-02-20T02:49:12.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47906683 4672.38 MB/sec execute 435 sec latency 5.820 ms 2026-02-20T02:49:12.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 129681 12.54 MB/sec execute 435 sec latency 42.197 ms 2026-02-20T02:49:13.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:12 trial106 ceph-mon[44052]: pgmap v757: 129 pgs: 129 active+clean; 445 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 232 op/s 2026-02-20T02:49:13.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:12 trial098 ceph-mon[38923]: pgmap v757: 129 pgs: 129 active+clean; 445 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 232 op/s 2026-02-20T02:49:13.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 47999805 4673.17 MB/sec execute 436 sec latency 3.296 ms 2026-02-20T02:49:13.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 129920 12.52 MB/sec execute 436 sec latency 43.498 ms 2026-02-20T02:49:14.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 48081542 4672.60 MB/sec execute 437 sec latency 98.665 ms 2026-02-20T02:49:14.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 130157 12.52 MB/sec execute 437 sec latency 72.493 ms 2026-02-20T02:49:15.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:14 trial106 ceph-mon[44052]: pgmap v758: 129 pgs: 129 active+clean; 432 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.5 MiB/s wr, 252 op/s 2026-02-20T02:49:15.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:14 trial098 ceph-mon[38923]: pgmap v758: 129 pgs: 129 active+clean; 432 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.5 MiB/s wr, 252 op/s 2026-02-20T02:49:15.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 48176249 4673.75 MB/sec execute 438 sec latency 2.846 ms 2026-02-20T02:49:15.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 130466 12.55 MB/sec execute 438 sec latency 45.992 ms 2026-02-20T02:49:16.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 48270840 4674.87 MB/sec execute 439 sec latency 3.913 ms 2026-02-20T02:49:16.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 130748 12.56 MB/sec execute 439 sec latency 47.400 ms 2026-02-20T02:49:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:16 trial106 ceph-mon[44052]: pgmap v759: 129 pgs: 129 active+clean; 415 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.8 MiB/s wr, 255 op/s 2026-02-20T02:49:17.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:16 trial098 ceph-mon[38923]: pgmap v759: 129 pgs: 129 active+clean; 415 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.8 MiB/s wr, 255 op/s 2026-02-20T02:49:17.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 48356157 4674.75 MB/sec execute 440 sec latency 47.008 ms 2026-02-20T02:49:17.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 131023 12.57 MB/sec execute 440 sec latency 58.654 ms 2026-02-20T02:49:18.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 48447046 4675.26 MB/sec execute 441 sec latency 3.550 ms 2026-02-20T02:49:18.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 131306 12.60 MB/sec execute 441 sec latency 55.561 ms 2026-02-20T02:49:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:18 trial106 ceph-mon[44052]: pgmap v760: 129 pgs: 129 active+clean; 425 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 245 op/s 2026-02-20T02:49:19.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:49:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:18 trial098 ceph-mon[38923]: pgmap v760: 129 pgs: 129 active+clean; 425 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 245 op/s 2026-02-20T02:49:19.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:49:19.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 48527267 4674.50 MB/sec execute 442 sec latency 81.589 ms 2026-02-20T02:49:19.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 131462 12.59 MB/sec execute 442 sec latency 134.068 ms 2026-02-20T02:49:20.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 48528512 4664.10 MB/sec execute 443 sec latency 117.120 ms 2026-02-20T02:49:20.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 131531 12.58 MB/sec execute 443 sec latency 234.473 ms 2026-02-20T02:49:21.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:20 trial106 ceph-mon[44052]: pgmap v761: 129 pgs: 129 active+clean; 434 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 5.7 MiB/s wr, 277 op/s 2026-02-20T02:49:21.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:20 trial098 ceph-mon[38923]: pgmap v761: 129 pgs: 129 active+clean; 434 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 5.7 MiB/s wr, 277 op/s 2026-02-20T02:49:21.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 48592422 4661.40 MB/sec execute 444 sec latency 86.076 ms 2026-02-20T02:49:21.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 131699 12.58 MB/sec execute 444 sec latency 123.182 ms 2026-02-20T02:49:22.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 48687514 4662.72 MB/sec execute 445 sec latency 3.722 ms 2026-02-20T02:49:22.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 131893 12.56 MB/sec execute 445 sec latency 49.134 ms 2026-02-20T02:49:23.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:22 trial106 ceph-mon[44052]: pgmap v762: 129 pgs: 129 active+clean; 439 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 279 op/s 2026-02-20T02:49:23.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:22 trial098 ceph-mon[38923]: pgmap v762: 129 pgs: 129 active+clean; 439 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 279 op/s 2026-02-20T02:49:23.517 INFO:tasks.workunit.client.0.trial098.stdout: 10 48782796 4663.82 MB/sec execute 446 sec latency 2.980 ms 2026-02-20T02:49:23.519 INFO:tasks.workunit.client.1.trial106.stdout: 10 132094 12.54 MB/sec execute 446 sec latency 56.944 ms 2026-02-20T02:49:24.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 48875077 4664.50 MB/sec execute 447 sec latency 3.400 ms 2026-02-20T02:49:24.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 132314 12.53 MB/sec execute 447 sec latency 59.271 ms 2026-02-20T02:49:25.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:24 trial106 ceph-mon[44052]: pgmap v763: 129 pgs: 129 active+clean; 440 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.1 MiB/s wr, 241 op/s 2026-02-20T02:49:25.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:24 trial098 ceph-mon[38923]: pgmap v763: 129 pgs: 129 active+clean; 440 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.1 MiB/s wr, 241 op/s 2026-02-20T02:49:25.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 48968513 4665.34 MB/sec execute 448 sec latency 4.351 ms 2026-02-20T02:49:25.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 132569 12.54 MB/sec execute 448 sec latency 48.309 ms 2026-02-20T02:49:26.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49060976 4666.17 MB/sec execute 449 sec latency 3.711 ms 2026-02-20T02:49:26.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 132813 12.53 MB/sec execute 449 sec latency 47.174 ms 2026-02-20T02:49:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:26 trial106 ceph-mon[44052]: pgmap v764: 129 pgs: 129 active+clean; 443 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 5.9 MiB/s wr, 213 op/s 2026-02-20T02:49:27.151 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:26 trial098 ceph-mon[38923]: pgmap v764: 129 pgs: 129 active+clean; 443 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 5.9 MiB/s wr, 213 op/s 2026-02-20T02:49:27.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49153716 4667.13 MB/sec execute 450 sec latency 3.007 ms 2026-02-20T02:49:27.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 133085 12.53 MB/sec execute 450 sec latency 47.615 ms 2026-02-20T02:49:28.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49246712 4667.95 MB/sec execute 451 sec latency 2.964 ms 2026-02-20T02:49:28.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 133322 12.52 MB/sec execute 451 sec latency 47.205 ms 2026-02-20T02:49:29.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:28 trial106 ceph-mon[44052]: pgmap v765: 129 pgs: 129 active+clean; 436 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 214 op/s 2026-02-20T02:49:29.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:28 trial098 ceph-mon[38923]: pgmap v765: 129 pgs: 129 active+clean; 436 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 214 op/s 2026-02-20T02:49:29.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49338695 4668.58 MB/sec execute 452 sec latency 25.874 ms 2026-02-20T02:49:29.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 133569 12.51 MB/sec execute 452 sec latency 42.801 ms 2026-02-20T02:49:30.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49432226 4669.45 MB/sec execute 453 sec latency 25.874 ms 2026-02-20T02:49:30.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 133816 12.51 MB/sec execute 453 sec latency 43.670 ms 2026-02-20T02:49:31.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:30 trial106 ceph-mon[44052]: pgmap v766: 129 pgs: 129 active+clean; 433 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 5.7 MiB/s wr, 250 op/s 2026-02-20T02:49:31.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:30 trial098 ceph-mon[38923]: pgmap v766: 129 pgs: 129 active+clean; 433 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 5.7 MiB/s wr, 250 op/s 2026-02-20T02:49:31.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49525941 4670.36 MB/sec execute 454 sec latency 5.466 ms 2026-02-20T02:49:31.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 134113 12.53 MB/sec execute 454 sec latency 41.538 ms 2026-02-20T02:49:32.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49616191 4671.01 MB/sec execute 455 sec latency 36.700 ms 2026-02-20T02:49:32.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 134395 12.55 MB/sec execute 455 sec latency 58.453 ms 2026-02-20T02:49:33.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:32 trial106 ceph-mon[44052]: pgmap v767: 129 pgs: 129 active+clean; 431 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 228 op/s 2026-02-20T02:49:33.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:32 trial098 ceph-mon[38923]: pgmap v767: 129 pgs: 129 active+clean; 431 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 228 op/s 2026-02-20T02:49:33.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49707142 4671.57 MB/sec execute 456 sec latency 21.145 ms 2026-02-20T02:49:33.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 134673 12.57 MB/sec execute 456 sec latency 41.383 ms 2026-02-20T02:49:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:49:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:49:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:49:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:49:34.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:49:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:49:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:49:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:49:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:49:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:49:34.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49797106 4671.94 MB/sec execute 457 sec latency 3.274 ms 2026-02-20T02:49:34.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 134915 12.59 MB/sec execute 457 sec latency 56.938 ms 2026-02-20T02:49:35.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:34 trial106 ceph-mon[44052]: pgmap v768: 129 pgs: 129 active+clean; 440 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 5.2 MiB/s wr, 237 op/s 2026-02-20T02:49:35.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:34 trial098 ceph-mon[38923]: pgmap v768: 129 pgs: 129 active+clean; 440 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 5.2 MiB/s wr, 237 op/s 2026-02-20T02:49:35.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49890775 4672.82 MB/sec execute 458 sec latency 2.771 ms 2026-02-20T02:49:35.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 135110 12.59 MB/sec execute 458 sec latency 48.330 ms 2026-02-20T02:49:36.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49961295 4670.95 MB/sec execute 459 sec latency 93.519 ms 2026-02-20T02:49:36.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 135282 12.58 MB/sec execute 459 sec latency 226.176 ms 2026-02-20T02:49:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:36 trial106 ceph-mon[44052]: pgmap v769: 129 pgs: 129 active+clean; 451 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 280 op/s 2026-02-20T02:49:37.287 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:36 trial098 ceph-mon[38923]: pgmap v769: 129 pgs: 129 active+clean; 451 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 6.0 MiB/s wr, 280 op/s 2026-02-20T02:49:37.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 49962808 4660.98 MB/sec execute 460 sec latency 140.436 ms 2026-02-20T02:49:37.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 135356 12.56 MB/sec execute 460 sec latency 226.322 ms 2026-02-20T02:49:38.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 50031668 4659.07 MB/sec execute 461 sec latency 88.417 ms 2026-02-20T02:49:38.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 135532 12.54 MB/sec execute 461 sec latency 127.237 ms 2026-02-20T02:49:39.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:38 trial106 ceph-mon[44052]: pgmap v770: 129 pgs: 129 active+clean; 453 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 246 op/s 2026-02-20T02:49:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:38 trial098 ceph-mon[38923]: pgmap v770: 129 pgs: 129 active+clean; 453 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 246 op/s 2026-02-20T02:49:39.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 50124677 4659.98 MB/sec execute 462 sec latency 10.566 ms 2026-02-20T02:49:39.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 135730 12.52 MB/sec execute 462 sec latency 53.796 ms 2026-02-20T02:49:40.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 50218506 4660.85 MB/sec execute 463 sec latency 5.162 ms 2026-02-20T02:49:40.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 135957 12.51 MB/sec execute 463 sec latency 45.513 ms 2026-02-20T02:49:41.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:40 trial106 ceph-mon[44052]: pgmap v771: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 249 op/s 2026-02-20T02:49:41.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:40 trial098 ceph-mon[38923]: pgmap v771: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 249 op/s 2026-02-20T02:49:41.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 50311685 4661.63 MB/sec execute 464 sec latency 4.577 ms 2026-02-20T02:49:41.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 136226 12.53 MB/sec execute 464 sec latency 57.956 ms 2026-02-20T02:49:42.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 50403107 4662.27 MB/sec execute 465 sec latency 16.124 ms 2026-02-20T02:49:42.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 136494 12.53 MB/sec execute 465 sec latency 47.245 ms 2026-02-20T02:49:43.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:42 trial106 ceph-mon[44052]: pgmap v772: 129 pgs: 129 active+clean; 454 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 191 op/s 2026-02-20T02:49:43.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:42 trial098 ceph-mon[38923]: pgmap v772: 129 pgs: 129 active+clean; 454 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 191 op/s 2026-02-20T02:49:43.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 50442894 4656.91 MB/sec execute 466 sec latency 116.768 ms 2026-02-20T02:49:43.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 136655 12.52 MB/sec execute 466 sec latency 146.052 ms 2026-02-20T02:49:44.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 50536071 4657.90 MB/sec execute 467 sec latency 3.693 ms 2026-02-20T02:49:44.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 136891 12.50 MB/sec execute 467 sec latency 41.714 ms 2026-02-20T02:49:45.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:44 trial106 ceph-mon[44052]: pgmap v773: 129 pgs: 129 active+clean; 442 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 255 op/s 2026-02-20T02:49:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:44 trial098 ceph-mon[38923]: pgmap v773: 129 pgs: 129 active+clean; 442 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 255 op/s 2026-02-20T02:49:45.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 50630568 4658.88 MB/sec execute 468 sec latency 2.880 ms 2026-02-20T02:49:45.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 137137 12.50 MB/sec execute 468 sec latency 46.690 ms 2026-02-20T02:49:46.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 50725529 4659.87 MB/sec execute 469 sec latency 2.988 ms 2026-02-20T02:49:46.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 137386 12.50 MB/sec execute 469 sec latency 51.742 ms 2026-02-20T02:49:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:46 trial106 ceph-mon[44052]: pgmap v774: 129 pgs: 129 active+clean; 417 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.5 MiB/s wr, 258 op/s 2026-02-20T02:49:47.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:46 trial098 ceph-mon[38923]: pgmap v774: 129 pgs: 129 active+clean; 417 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.5 MiB/s wr, 258 op/s 2026-02-20T02:49:47.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 50819040 4660.71 MB/sec execute 470 sec latency 3.574 ms 2026-02-20T02:49:47.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 137705 12.52 MB/sec execute 470 sec latency 46.610 ms 2026-02-20T02:49:48.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 50910384 4661.37 MB/sec execute 471 sec latency 16.448 ms 2026-02-20T02:49:48.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 137980 12.54 MB/sec execute 471 sec latency 55.785 ms 2026-02-20T02:49:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:48 trial106 ceph-mon[44052]: pgmap v775: 129 pgs: 129 active+clean; 419 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 222 op/s 2026-02-20T02:49:49.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:49:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:48 trial098 ceph-mon[38923]: pgmap v775: 129 pgs: 129 active+clean; 419 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 222 op/s 2026-02-20T02:49:49.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:49:49.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51004108 4662.38 MB/sec execute 472 sec latency 3.911 ms 2026-02-20T02:49:49.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 138296 12.57 MB/sec execute 472 sec latency 39.275 ms 2026-02-20T02:49:50.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51096319 4663.09 MB/sec execute 473 sec latency 19.752 ms 2026-02-20T02:49:50.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 138492 12.56 MB/sec execute 473 sec latency 53.207 ms 2026-02-20T02:49:51.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:50 trial106 ceph-mon[44052]: pgmap v776: 129 pgs: 129 active+clean; 429 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 261 op/s 2026-02-20T02:49:51.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:50 trial098 ceph-mon[38923]: pgmap v776: 129 pgs: 129 active+clean; 429 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 8.5 KiB/s rd, 5.0 MiB/s wr, 261 op/s 2026-02-20T02:49:51.518 INFO:tasks.workunit.client.0.trial098.stdout: 10 51190367 4663.92 MB/sec execute 474 sec latency 3.718 ms 2026-02-20T02:49:51.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 138696 12.57 MB/sec execute 474 sec latency 54.087 ms 2026-02-20T02:49:52.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51283569 4664.73 MB/sec execute 475 sec latency 3.067 ms 2026-02-20T02:49:52.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 138901 12.56 MB/sec execute 475 sec latency 58.462 ms 2026-02-20T02:49:53.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:52 trial106 ceph-mon[44052]: pgmap v777: 129 pgs: 129 active+clean; 435 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 249 op/s 2026-02-20T02:49:53.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:52 trial098 ceph-mon[38923]: pgmap v777: 129 pgs: 129 active+clean; 435 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 249 op/s 2026-02-20T02:49:53.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51374670 4665.39 MB/sec execute 476 sec latency 3.745 ms 2026-02-20T02:49:53.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 139104 12.55 MB/sec execute 476 sec latency 45.662 ms 2026-02-20T02:49:54.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51454750 4664.81 MB/sec execute 477 sec latency 100.554 ms 2026-02-20T02:49:54.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 139295 12.53 MB/sec execute 477 sec latency 111.982 ms 2026-02-20T02:49:55.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:54 trial106 ceph-mon[44052]: pgmap v778: 129 pgs: 129 active+clean; 439 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 6.0 MiB/s wr, 248 op/s 2026-02-20T02:49:55.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:54 trial098 ceph-mon[38923]: pgmap v778: 129 pgs: 129 active+clean; 439 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 6.0 MiB/s wr, 248 op/s 2026-02-20T02:49:55.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51546468 4665.43 MB/sec execute 478 sec latency 3.300 ms 2026-02-20T02:49:55.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 139531 12.52 MB/sec execute 478 sec latency 54.610 ms 2026-02-20T02:49:56.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51640166 4666.22 MB/sec execute 479 sec latency 3.537 ms 2026-02-20T02:49:56.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 139792 12.54 MB/sec execute 479 sec latency 49.742 ms 2026-02-20T02:49:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:56 trial106 ceph-mon[44052]: pgmap v779: 129 pgs: 129 active+clean; 444 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 6.1 MiB/s wr, 227 op/s 2026-02-20T02:49:57.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:56 trial098 ceph-mon[38923]: pgmap v779: 129 pgs: 129 active+clean; 444 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 6.1 MiB/s wr, 227 op/s 2026-02-20T02:49:57.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51732599 4666.92 MB/sec execute 480 sec latency 3.589 ms 2026-02-20T02:49:57.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 140078 12.54 MB/sec execute 480 sec latency 44.085 ms 2026-02-20T02:49:58.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51820957 4667.19 MB/sec execute 481 sec latency 50.425 ms 2026-02-20T02:49:58.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 140308 12.53 MB/sec execute 481 sec latency 39.953 ms 2026-02-20T02:49:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:49:58 trial106 ceph-mon[44052]: pgmap v780: 129 pgs: 129 active+clean; 438 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 225 op/s 2026-02-20T02:49:59.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:49:58 trial098 ceph-mon[38923]: pgmap v780: 129 pgs: 129 active+clean; 438 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 225 op/s 2026-02-20T02:49:59.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51847961 4660.64 MB/sec execute 482 sec latency 125.829 ms 2026-02-20T02:49:59.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 140454 12.51 MB/sec execute 482 sec latency 141.058 ms 2026-02-20T02:50:00.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51872627 4653.81 MB/sec execute 483 sec latency 107.676 ms 2026-02-20T02:50:00.520 INFO:tasks.workunit.client.1.trial106.stdout: 10 140598 12.50 MB/sec execute 483 sec latency 140.750 ms 2026-02-20T02:50:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:00 trial106 ceph-mon[44052]: pgmap v781: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.4 MiB/s wr, 253 op/s 2026-02-20T02:50:01.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:00 trial106 ceph-mon[44052]: overall HEALTH_OK 2026-02-20T02:50:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:00 trial098 ceph-mon[38923]: pgmap v781: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.4 MiB/s wr, 253 op/s 2026-02-20T02:50:01.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:00 trial098 ceph-mon[38923]: overall HEALTH_OK 2026-02-20T02:50:01.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 51966174 4654.69 MB/sec execute 484 sec latency 68.029 ms 2026-02-20T02:50:01.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 140836 12.49 MB/sec execute 484 sec latency 50.421 ms 2026-02-20T02:50:02.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52059727 4655.49 MB/sec execute 485 sec latency 4.930 ms 2026-02-20T02:50:02.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 141128 12.51 MB/sec execute 485 sec latency 40.279 ms 2026-02-20T02:50:03.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:02 trial098 ceph-mon[38923]: pgmap v782: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 249 op/s 2026-02-20T02:50:03.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:02 trial106 ceph-mon[44052]: pgmap v782: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 249 op/s 2026-02-20T02:50:03.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52150539 4655.98 MB/sec execute 486 sec latency 18.088 ms 2026-02-20T02:50:03.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 141429 12.53 MB/sec execute 486 sec latency 49.147 ms 2026-02-20T02:50:04.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:50:04.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:50:04.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52240670 4656.48 MB/sec execute 487 sec latency 3.795 ms 2026-02-20T02:50:04.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 141711 12.54 MB/sec execute 487 sec latency 53.414 ms 2026-02-20T02:50:05.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:04 trial098 ceph-mon[38923]: pgmap v783: 129 pgs: 129 active+clean; 436 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 5.4 MiB/s wr, 251 op/s 2026-02-20T02:50:05.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:04 trial106 ceph-mon[44052]: pgmap v783: 129 pgs: 129 active+clean; 436 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 5.4 MiB/s wr, 251 op/s 2026-02-20T02:50:05.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52330489 4657.02 MB/sec execute 488 sec latency 20.917 ms 2026-02-20T02:50:05.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 141976 12.56 MB/sec execute 488 sec latency 39.037 ms 2026-02-20T02:50:06.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52424087 4657.91 MB/sec execute 489 sec latency 3.981 ms 2026-02-20T02:50:06.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 142168 12.57 MB/sec execute 489 sec latency 63.235 ms 2026-02-20T02:50:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:06 trial106 ceph-mon[44052]: pgmap v784: 129 pgs: 129 active+clean; 443 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 5.3 MiB/s wr, 262 op/s 2026-02-20T02:50:07.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:06 trial098 ceph-mon[38923]: pgmap v784: 129 pgs: 129 active+clean; 443 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 5.3 MiB/s wr, 262 op/s 2026-02-20T02:50:07.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52515222 4658.45 MB/sec execute 490 sec latency 5.873 ms 2026-02-20T02:50:07.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 142363 12.57 MB/sec execute 490 sec latency 51.574 ms 2026-02-20T02:50:08.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52604964 4658.81 MB/sec execute 491 sec latency 19.355 ms 2026-02-20T02:50:08.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 142559 12.55 MB/sec execute 491 sec latency 47.180 ms 2026-02-20T02:50:09.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:08 trial098 ceph-mon[38923]: pgmap v785: 129 pgs: 129 active+clean; 455 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 247 op/s 2026-02-20T02:50:09.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:08 trial106 ceph-mon[44052]: pgmap v785: 129 pgs: 129 active+clean; 455 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 247 op/s 2026-02-20T02:50:09.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52695073 4659.29 MB/sec execute 492 sec latency 4.809 ms 2026-02-20T02:50:09.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 142756 12.53 MB/sec execute 492 sec latency 53.583 ms 2026-02-20T02:50:10.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 52787606 4660.12 MB/sec execute 493 sec latency 4.423 ms 2026-02-20T02:50:10.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 142981 12.52 MB/sec execute 493 sec latency 48.214 ms 2026-02-20T02:50:11.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:10 trial098 ceph-mon[38923]: pgmap v786: 129 pgs: 129 active+clean; 460 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.6 KiB/s rd, 6.2 MiB/s wr, 263 op/s 2026-02-20T02:50:11.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:10 trial106 ceph-mon[44052]: pgmap v786: 129 pgs: 129 active+clean; 460 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.6 KiB/s rd, 6.2 MiB/s wr, 263 op/s 2026-02-20T02:50:11.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52867950 4659.52 MB/sec execute 494 sec latency 101.977 ms 2026-02-20T02:50:11.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 143245 12.53 MB/sec execute 494 sec latency 48.341 ms 2026-02-20T02:50:12.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 52961099 4660.30 MB/sec execute 495 sec latency 4.720 ms 2026-02-20T02:50:12.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 143507 12.53 MB/sec execute 495 sec latency 52.164 ms 2026-02-20T02:50:13.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:12 trial098 ceph-mon[38923]: pgmap v787: 129 pgs: 129 active+clean; 448 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 237 op/s 2026-02-20T02:50:13.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:12 trial106 ceph-mon[44052]: pgmap v787: 129 pgs: 129 active+clean; 448 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 237 op/s 2026-02-20T02:50:13.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 53051299 4660.69 MB/sec execute 496 sec latency 19.624 ms 2026-02-20T02:50:13.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 143743 12.53 MB/sec execute 496 sec latency 47.510 ms 2026-02-20T02:50:14.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 53140356 4661.06 MB/sec execute 497 sec latency 3.974 ms 2026-02-20T02:50:14.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 143983 12.52 MB/sec execute 497 sec latency 40.101 ms 2026-02-20T02:50:15.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:14 trial098 ceph-mon[38923]: pgmap v788: 129 pgs: 129 active+clean; 427 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.1 MiB/s wr, 212 op/s 2026-02-20T02:50:15.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:14 trial106 ceph-mon[44052]: pgmap v788: 129 pgs: 129 active+clean; 427 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.1 MiB/s wr, 212 op/s 2026-02-20T02:50:15.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 53232975 4661.86 MB/sec execute 498 sec latency 2.877 ms 2026-02-20T02:50:15.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 144237 12.51 MB/sec execute 498 sec latency 49.083 ms 2026-02-20T02:50:16.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 53250418 4654.44 MB/sec execute 499 sec latency 113.297 ms 2026-02-20T02:50:16.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 144342 12.50 MB/sec execute 499 sec latency 179.574 ms 2026-02-20T02:50:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:16 trial106 ceph-mon[44052]: pgmap v789: 129 pgs: 129 active+clean; 416 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.3 MiB/s wr, 256 op/s 2026-02-20T02:50:17.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:16 trial098 ceph-mon[38923]: pgmap v789: 129 pgs: 129 active+clean; 416 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.3 MiB/s wr, 256 op/s 2026-02-20T02:50:17.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 53280436 4648.43 MB/sec execute 500 sec latency 98.317 ms 2026-02-20T02:50:17.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 144516 12.50 MB/sec execute 500 sec latency 117.938 ms 2026-02-20T02:50:18.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 53373135 4649.16 MB/sec execute 501 sec latency 20.218 ms 2026-02-20T02:50:18.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 144838 12.51 MB/sec execute 501 sec latency 42.789 ms 2026-02-20T02:50:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:18 trial098 ceph-mon[38923]: pgmap v790: 129 pgs: 129 active+clean; 417 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 272 op/s 2026-02-20T02:50:19.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:50:19.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:18 trial106 ceph-mon[44052]: pgmap v790: 129 pgs: 129 active+clean; 417 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 272 op/s 2026-02-20T02:50:19.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:50:19.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 53465917 4649.88 MB/sec execute 502 sec latency 13.572 ms 2026-02-20T02:50:19.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 145108 12.53 MB/sec execute 502 sec latency 44.822 ms 2026-02-20T02:50:20.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 53557475 4650.46 MB/sec execute 503 sec latency 16.856 ms 2026-02-20T02:50:20.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 145375 12.55 MB/sec execute 503 sec latency 51.753 ms 2026-02-20T02:50:21.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:20 trial098 ceph-mon[38923]: pgmap v791: 129 pgs: 129 active+clean; 419 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 4.8 MiB/s wr, 237 op/s 2026-02-20T02:50:21.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:20 trial106 ceph-mon[44052]: pgmap v791: 129 pgs: 129 active+clean; 419 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 4.8 MiB/s wr, 237 op/s 2026-02-20T02:50:21.519 INFO:tasks.workunit.client.0.trial098.stdout: 10 53651224 4651.34 MB/sec execute 504 sec latency 3.042 ms 2026-02-20T02:50:21.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 145615 12.56 MB/sec execute 504 sec latency 59.742 ms 2026-02-20T02:50:22.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 53743586 4652.16 MB/sec execute 505 sec latency 4.163 ms 2026-02-20T02:50:22.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 145807 12.56 MB/sec execute 505 sec latency 49.425 ms 2026-02-20T02:50:23.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:22 trial098 ceph-mon[38923]: pgmap v792: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 239 op/s 2026-02-20T02:50:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:22 trial106 ceph-mon[44052]: pgmap v792: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 239 op/s 2026-02-20T02:50:23.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 53837059 4652.98 MB/sec execute 506 sec latency 5.082 ms 2026-02-20T02:50:23.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 146009 12.55 MB/sec execute 506 sec latency 45.747 ms 2026-02-20T02:50:24.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 53929607 4653.65 MB/sec execute 507 sec latency 2.641 ms 2026-02-20T02:50:24.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 146220 12.54 MB/sec execute 507 sec latency 51.841 ms 2026-02-20T02:50:25.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:24 trial098 ceph-mon[38923]: pgmap v793: 129 pgs: 129 active+clean; 437 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 241 op/s 2026-02-20T02:50:25.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:24 trial106 ceph-mon[44052]: pgmap v793: 129 pgs: 129 active+clean; 437 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 5.7 MiB/s wr, 241 op/s 2026-02-20T02:50:25.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54020298 4654.14 MB/sec execute 508 sec latency 3.255 ms 2026-02-20T02:50:25.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 146433 12.53 MB/sec execute 508 sec latency 55.253 ms 2026-02-20T02:50:26.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54111619 4654.73 MB/sec execute 509 sec latency 2.607 ms 2026-02-20T02:50:26.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 146677 12.52 MB/sec execute 509 sec latency 54.953 ms 2026-02-20T02:50:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:26 trial106 ceph-mon[44052]: pgmap v794: 129 pgs: 129 active+clean; 442 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.1 MiB/s wr, 257 op/s 2026-02-20T02:50:27.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:26 trial098 ceph-mon[38923]: pgmap v794: 129 pgs: 129 active+clean; 442 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.1 MiB/s wr, 257 op/s 2026-02-20T02:50:27.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54202054 4655.37 MB/sec execute 510 sec latency 5.197 ms 2026-02-20T02:50:27.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 146936 12.53 MB/sec execute 510 sec latency 51.475 ms 2026-02-20T02:50:28.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54291989 4655.79 MB/sec execute 511 sec latency 16.199 ms 2026-02-20T02:50:28.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 147201 12.53 MB/sec execute 511 sec latency 44.155 ms 2026-02-20T02:50:29.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:28 trial098 ceph-mon[38923]: pgmap v795: 129 pgs: 129 active+clean; 440 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 228 op/s 2026-02-20T02:50:29.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:28 trial106 ceph-mon[44052]: pgmap v795: 129 pgs: 129 active+clean; 440 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 228 op/s 2026-02-20T02:50:29.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54384170 4656.40 MB/sec execute 512 sec latency 2.657 ms 2026-02-20T02:50:29.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 147437 12.52 MB/sec execute 512 sec latency 47.905 ms 2026-02-20T02:50:30.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54474042 4656.79 MB/sec execute 513 sec latency 3.025 ms 2026-02-20T02:50:30.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 147693 12.52 MB/sec execute 513 sec latency 40.142 ms 2026-02-20T02:50:31.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:30 trial098 ceph-mon[38923]: pgmap v796: 129 pgs: 129 active+clean; 434 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 219 op/s 2026-02-20T02:50:31.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:30 trial106 ceph-mon[44052]: pgmap v796: 129 pgs: 129 active+clean; 434 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 219 op/s 2026-02-20T02:50:31.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54562184 4657.01 MB/sec execute 514 sec latency 27.034 ms 2026-02-20T02:50:31.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 147926 12.51 MB/sec execute 514 sec latency 51.148 ms 2026-02-20T02:50:32.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54653204 4657.70 MB/sec execute 515 sec latency 5.164 ms 2026-02-20T02:50:32.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 148206 12.52 MB/sec execute 515 sec latency 52.864 ms 2026-02-20T02:50:33.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:32 trial098 ceph-mon[38923]: pgmap v797: 129 pgs: 129 active+clean; 431 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 264 op/s 2026-02-20T02:50:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:32 trial106 ceph-mon[44052]: pgmap v797: 129 pgs: 129 active+clean; 431 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 264 op/s 2026-02-20T02:50:33.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54661062 4649.54 MB/sec execute 516 sec latency 134.560 ms 2026-02-20T02:50:33.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 148342 12.51 MB/sec execute 516 sec latency 188.240 ms 2026-02-20T02:50:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:50:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:50:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:50:34.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:50:34.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:50:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:50:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:50:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:50:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:50:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:50:34.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54685643 4643.12 MB/sec execute 517 sec latency 87.996 ms 2026-02-20T02:50:34.521 INFO:tasks.workunit.client.1.trial106.stdout: 10 148530 12.52 MB/sec execute 517 sec latency 126.219 ms 2026-02-20T02:50:35.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:34 trial098 ceph-mon[38923]: pgmap v798: 129 pgs: 129 active+clean; 434 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.9 MiB/s wr, 245 op/s 2026-02-20T02:50:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:34 trial106 ceph-mon[44052]: pgmap v798: 129 pgs: 129 active+clean; 434 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.9 MiB/s wr, 245 op/s 2026-02-20T02:50:35.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54778689 4643.85 MB/sec execute 518 sec latency 3.028 ms 2026-02-20T02:50:35.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 148813 12.53 MB/sec execute 518 sec latency 38.961 ms 2026-02-20T02:50:36.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54872124 4644.61 MB/sec execute 519 sec latency 3.067 ms 2026-02-20T02:50:36.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 149076 12.55 MB/sec execute 519 sec latency 54.705 ms 2026-02-20T02:50:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:36 trial106 ceph-mon[44052]: pgmap v799: 129 pgs: 129 active+clean; 444 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.7 MiB/s wr, 270 op/s 2026-02-20T02:50:37.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:36 trial098 ceph-mon[38923]: pgmap v799: 129 pgs: 129 active+clean; 444 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.7 MiB/s wr, 270 op/s 2026-02-20T02:50:37.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 54966279 4645.50 MB/sec execute 520 sec latency 3.091 ms 2026-02-20T02:50:37.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 149275 12.56 MB/sec execute 520 sec latency 47.386 ms 2026-02-20T02:50:38.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55058497 4646.26 MB/sec execute 521 sec latency 4.043 ms 2026-02-20T02:50:38.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 149469 12.55 MB/sec execute 521 sec latency 54.848 ms 2026-02-20T02:50:39.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:38 trial098 ceph-mon[38923]: pgmap v800: 129 pgs: 129 active+clean; 448 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 234 op/s 2026-02-20T02:50:39.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:38 trial106 ceph-mon[44052]: pgmap v800: 129 pgs: 129 active+clean; 448 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 234 op/s 2026-02-20T02:50:39.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55149260 4646.83 MB/sec execute 522 sec latency 9.972 ms 2026-02-20T02:50:39.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 149665 12.54 MB/sec execute 522 sec latency 48.551 ms 2026-02-20T02:50:40.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55180621 4641.20 MB/sec execute 523 sec latency 135.103 ms 2026-02-20T02:50:40.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 149781 12.52 MB/sec execute 523 sec latency 162.860 ms 2026-02-20T02:50:41.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:40 trial098 ceph-mon[38923]: pgmap v801: 129 pgs: 129 active+clean; 456 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 5.8 MiB/s wr, 251 op/s 2026-02-20T02:50:41.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:40 trial106 ceph-mon[44052]: pgmap v801: 129 pgs: 129 active+clean; 456 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 5.8 MiB/s wr, 251 op/s 2026-02-20T02:50:41.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55273397 4641.90 MB/sec execute 524 sec latency 19.120 ms 2026-02-20T02:50:41.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 149993 12.51 MB/sec execute 524 sec latency 46.052 ms 2026-02-20T02:50:42.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 55367458 4642.72 MB/sec execute 525 sec latency 3.997 ms 2026-02-20T02:50:42.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 150250 12.52 MB/sec execute 525 sec latency 60.157 ms 2026-02-20T02:50:43.229 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:42 trial098 ceph-mon[38923]: pgmap v802: 129 pgs: 129 active+clean; 439 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 244 op/s 2026-02-20T02:50:43.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:42 trial106 ceph-mon[44052]: pgmap v802: 129 pgs: 129 active+clean; 439 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 244 op/s 2026-02-20T02:50:43.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55460173 4643.46 MB/sec execute 526 sec latency 4.785 ms 2026-02-20T02:50:43.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 150516 12.52 MB/sec execute 526 sec latency 60.716 ms 2026-02-20T02:50:44.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 55549825 4643.99 MB/sec execute 527 sec latency 15.105 ms 2026-02-20T02:50:44.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 150755 12.51 MB/sec execute 527 sec latency 45.570 ms 2026-02-20T02:50:45.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:44 trial098 ceph-mon[38923]: pgmap v803: 129 pgs: 129 active+clean; 432 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.1 MiB/s wr, 220 op/s 2026-02-20T02:50:45.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:44 trial106 ceph-mon[44052]: pgmap v803: 129 pgs: 129 active+clean; 432 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.1 MiB/s wr, 220 op/s 2026-02-20T02:50:45.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 55642730 4644.76 MB/sec execute 528 sec latency 2.587 ms 2026-02-20T02:50:45.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 150992 12.50 MB/sec execute 528 sec latency 41.582 ms 2026-02-20T02:50:46.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55681505 4639.95 MB/sec execute 529 sec latency 138.757 ms 2026-02-20T02:50:46.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 151185 12.50 MB/sec execute 529 sec latency 134.441 ms 2026-02-20T02:50:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:46 trial106 ceph-mon[44052]: pgmap v804: 129 pgs: 129 active+clean; 421 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 5.9 MiB/s wr, 237 op/s 2026-02-20T02:50:47.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:46 trial098 ceph-mon[38923]: pgmap v804: 129 pgs: 129 active+clean; 421 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 5.9 MiB/s wr, 237 op/s 2026-02-20T02:50:47.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55776051 4640.80 MB/sec execute 530 sec latency 4.026 ms 2026-02-20T02:50:47.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 151403 12.49 MB/sec execute 530 sec latency 42.247 ms 2026-02-20T02:50:48.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55869799 4641.60 MB/sec execute 531 sec latency 4.948 ms 2026-02-20T02:50:48.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 151689 12.50 MB/sec execute 531 sec latency 42.866 ms 2026-02-20T02:50:49.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:48 trial098 ceph-mon[38923]: pgmap v805: 129 pgs: 129 active+clean; 418 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 219 op/s 2026-02-20T02:50:49.194 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:50:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:48 trial106 ceph-mon[44052]: pgmap v805: 129 pgs: 129 active+clean; 418 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 219 op/s 2026-02-20T02:50:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:50:49.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 55957990 4641.99 MB/sec execute 532 sec latency 46.556 ms 2026-02-20T02:50:49.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 152007 12.51 MB/sec execute 532 sec latency 75.564 ms 2026-02-20T02:50:50.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 56049276 4642.60 MB/sec execute 533 sec latency 3.903 ms 2026-02-20T02:50:50.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 152231 12.52 MB/sec execute 533 sec latency 44.610 ms 2026-02-20T02:50:51.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:50 trial098 ceph-mon[38923]: pgmap v806: 129 pgs: 129 active+clean; 421 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.3 MiB/s wr, 259 op/s 2026-02-20T02:50:51.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:50 trial106 ceph-mon[44052]: pgmap v806: 129 pgs: 129 active+clean; 421 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.3 MiB/s wr, 259 op/s 2026-02-20T02:50:51.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 56138336 4642.94 MB/sec execute 534 sec latency 32.751 ms 2026-02-20T02:50:51.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 152531 12.55 MB/sec execute 534 sec latency 46.699 ms 2026-02-20T02:50:52.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 56180911 4638.55 MB/sec execute 535 sec latency 124.889 ms 2026-02-20T02:50:52.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 152694 12.55 MB/sec execute 535 sec latency 146.209 ms 2026-02-20T02:50:53.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:52 trial098 ceph-mon[38923]: pgmap v807: 129 pgs: 129 active+clean; 429 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 228 op/s 2026-02-20T02:50:53.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:52 trial106 ceph-mon[44052]: pgmap v807: 129 pgs: 129 active+clean; 429 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 228 op/s 2026-02-20T02:50:53.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 56274561 4639.31 MB/sec execute 536 sec latency 3.602 ms 2026-02-20T02:50:53.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 152876 12.54 MB/sec execute 536 sec latency 50.507 ms 2026-02-20T02:50:54.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 56368655 4640.18 MB/sec execute 537 sec latency 3.503 ms 2026-02-20T02:50:54.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 153072 12.54 MB/sec execute 537 sec latency 51.675 ms 2026-02-20T02:50:55.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:54 trial098 ceph-mon[38923]: pgmap v808: 129 pgs: 129 active+clean; 438 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 5.8 MiB/s wr, 250 op/s 2026-02-20T02:50:55.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:54 trial106 ceph-mon[44052]: pgmap v808: 129 pgs: 129 active+clean; 438 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 5.8 MiB/s wr, 250 op/s 2026-02-20T02:50:55.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 56457775 4640.64 MB/sec execute 538 sec latency 21.468 ms 2026-02-20T02:50:55.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 153274 12.52 MB/sec execute 538 sec latency 52.080 ms 2026-02-20T02:50:56.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 56548633 4641.22 MB/sec execute 539 sec latency 3.661 ms 2026-02-20T02:50:56.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 153478 12.51 MB/sec execute 539 sec latency 48.679 ms 2026-02-20T02:50:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:56 trial106 ceph-mon[44052]: pgmap v809: 129 pgs: 129 active+clean; 444 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 255 op/s 2026-02-20T02:50:57.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:56 trial098 ceph-mon[38923]: pgmap v809: 129 pgs: 129 active+clean; 444 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 255 op/s 2026-02-20T02:50:57.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 56638859 4641.63 MB/sec execute 540 sec latency 5.953 ms 2026-02-20T02:50:57.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 153702 12.50 MB/sec execute 540 sec latency 57.980 ms 2026-02-20T02:50:58.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 56730414 4642.18 MB/sec execute 541 sec latency 3.213 ms 2026-02-20T02:50:58.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 153979 12.52 MB/sec execute 541 sec latency 45.812 ms 2026-02-20T02:50:59.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:50:58 trial098 ceph-mon[38923]: pgmap v810: 129 pgs: 129 active+clean; 446 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 242 op/s 2026-02-20T02:50:59.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:50:58 trial106 ceph-mon[44052]: pgmap v810: 129 pgs: 129 active+clean; 446 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 242 op/s 2026-02-20T02:50:59.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 56817534 4642.32 MB/sec execute 542 sec latency 62.460 ms 2026-02-20T02:50:59.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 154236 12.51 MB/sec execute 542 sec latency 62.303 ms 2026-02-20T02:51:00.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 56910981 4643.18 MB/sec execute 543 sec latency 4.749 ms 2026-02-20T02:51:00.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 154490 12.51 MB/sec execute 543 sec latency 39.137 ms 2026-02-20T02:51:01.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:00 trial098 ceph-mon[38923]: pgmap v811: 129 pgs: 129 active+clean; 444 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.2 MiB/s wr, 229 op/s 2026-02-20T02:51:01.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:00 trial106 ceph-mon[44052]: pgmap v811: 129 pgs: 129 active+clean; 444 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.2 MiB/s wr, 229 op/s 2026-02-20T02:51:01.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 57003453 4643.91 MB/sec execute 544 sec latency 3.469 ms 2026-02-20T02:51:01.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 154748 12.50 MB/sec execute 544 sec latency 43.505 ms 2026-02-20T02:51:02.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 57086386 4643.63 MB/sec execute 545 sec latency 102.762 ms 2026-02-20T02:51:02.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 154953 12.49 MB/sec execute 545 sec latency 67.139 ms 2026-02-20T02:51:03.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:02 trial098 ceph-mon[38923]: pgmap v812: 129 pgs: 129 active+clean; 438 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 257 op/s 2026-02-20T02:51:03.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:02 trial106 ceph-mon[44052]: pgmap v812: 129 pgs: 129 active+clean; 438 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 257 op/s 2026-02-20T02:51:03.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 57179798 4644.35 MB/sec execute 546 sec latency 2.636 ms 2026-02-20T02:51:03.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 155230 12.50 MB/sec execute 546 sec latency 51.909 ms 2026-02-20T02:51:04.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:51:04.366 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:51:04.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 57271112 4644.92 MB/sec execute 547 sec latency 4.224 ms 2026-02-20T02:51:04.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 155568 12.52 MB/sec execute 547 sec latency 45.943 ms 2026-02-20T02:51:05.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:04 trial098 ceph-mon[38923]: pgmap v813: 129 pgs: 129 active+clean; 433 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 268 op/s 2026-02-20T02:51:05.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:04 trial106 ceph-mon[44052]: pgmap v813: 129 pgs: 129 active+clean; 433 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 268 op/s 2026-02-20T02:51:05.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 57362777 4645.58 MB/sec execute 548 sec latency 2.754 ms 2026-02-20T02:51:05.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 155811 12.54 MB/sec execute 548 sec latency 43.469 ms 2026-02-20T02:51:06.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 57450921 4645.86 MB/sec execute 549 sec latency 16.251 ms 2026-02-20T02:51:06.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 156116 12.56 MB/sec execute 549 sec latency 48.298 ms 2026-02-20T02:51:07.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:06 trial106 ceph-mon[44052]: pgmap v814: 129 pgs: 129 active+clean; 441 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.4 MiB/s wr, 257 op/s 2026-02-20T02:51:07.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:06 trial098 ceph-mon[38923]: pgmap v814: 129 pgs: 129 active+clean; 441 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.4 MiB/s wr, 257 op/s 2026-02-20T02:51:07.520 INFO:tasks.workunit.client.0.trial098.stdout: 10 57532921 4645.49 MB/sec execute 550 sec latency 100.116 ms 2026-02-20T02:51:07.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 156285 12.56 MB/sec execute 550 sec latency 93.830 ms 2026-02-20T02:51:08.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 57534451 4637.21 MB/sec execute 551 sec latency 137.880 ms 2026-02-20T02:51:08.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 156370 12.55 MB/sec execute 551 sec latency 144.395 ms 2026-02-20T02:51:09.192 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:08 trial098 ceph-mon[38923]: pgmap v815: 129 pgs: 129 active+clean; 446 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 258 op/s 2026-02-20T02:51:09.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:08 trial106 ceph-mon[44052]: pgmap v815: 129 pgs: 129 active+clean; 446 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 258 op/s 2026-02-20T02:51:09.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 57598071 4635.02 MB/sec execute 552 sec latency 122.159 ms 2026-02-20T02:51:09.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 156543 12.54 MB/sec execute 552 sec latency 109.273 ms 2026-02-20T02:51:10.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 57691219 4635.75 MB/sec execute 553 sec latency 23.048 ms 2026-02-20T02:51:10.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 156728 12.53 MB/sec execute 553 sec latency 54.169 ms 2026-02-20T02:51:11.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:10 trial098 ceph-mon[38923]: pgmap v816: 129 pgs: 129 active+clean; 434 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 5.6 MiB/s wr, 244 op/s 2026-02-20T02:51:11.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:10 trial106 ceph-mon[44052]: pgmap v816: 129 pgs: 129 active+clean; 434 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 5.6 MiB/s wr, 244 op/s 2026-02-20T02:51:11.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 57784011 4636.50 MB/sec execute 554 sec latency 4.875 ms 2026-02-20T02:51:11.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 156938 12.51 MB/sec execute 554 sec latency 43.593 ms 2026-02-20T02:51:12.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 57873410 4636.98 MB/sec execute 555 sec latency 4.459 ms 2026-02-20T02:51:12.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 157153 12.50 MB/sec execute 555 sec latency 52.549 ms 2026-02-20T02:51:13.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:12 trial098 ceph-mon[38923]: pgmap v817: 129 pgs: 129 active+clean; 432 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 272 op/s 2026-02-20T02:51:13.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:12 trial106 ceph-mon[44052]: pgmap v817: 129 pgs: 129 active+clean; 432 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 272 op/s 2026-02-20T02:51:13.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 57964311 4637.49 MB/sec execute 556 sec latency 4.770 ms 2026-02-20T02:51:13.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 157433 12.52 MB/sec execute 556 sec latency 47.271 ms 2026-02-20T02:51:14.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58055241 4637.97 MB/sec execute 557 sec latency 3.714 ms 2026-02-20T02:51:14.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 157681 12.51 MB/sec execute 557 sec latency 51.677 ms 2026-02-20T02:51:15.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:14 trial098 ceph-mon[38923]: pgmap v818: 129 pgs: 129 active+clean; 433 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 218 op/s 2026-02-20T02:51:15.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:14 trial106 ceph-mon[44052]: pgmap v818: 129 pgs: 129 active+clean; 433 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 218 op/s 2026-02-20T02:51:15.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58144458 4638.31 MB/sec execute 558 sec latency 18.595 ms 2026-02-20T02:51:15.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 157922 12.51 MB/sec execute 558 sec latency 53.368 ms 2026-02-20T02:51:16.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58236387 4638.96 MB/sec execute 559 sec latency 2.937 ms 2026-02-20T02:51:16.522 INFO:tasks.workunit.client.1.trial106.stdout: 10 158167 12.50 MB/sec execute 559 sec latency 49.770 ms 2026-02-20T02:51:17.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:16 trial106 ceph-mon[44052]: pgmap v819: 129 pgs: 129 active+clean; 426 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 223 op/s 2026-02-20T02:51:17.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:16 trial098 ceph-mon[38923]: pgmap v819: 129 pgs: 129 active+clean; 426 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 223 op/s 2026-02-20T02:51:17.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58328178 4639.65 MB/sec execute 560 sec latency 3.051 ms 2026-02-20T02:51:17.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 158411 12.49 MB/sec execute 560 sec latency 39.582 ms 2026-02-20T02:51:18.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58420222 4640.28 MB/sec execute 561 sec latency 3.263 ms 2026-02-20T02:51:18.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 158644 12.49 MB/sec execute 561 sec latency 44.035 ms 2026-02-20T02:51:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:18 trial098 ceph-mon[38923]: pgmap v820: 129 pgs: 129 active+clean; 423 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 237 op/s 2026-02-20T02:51:19.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:18 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:51:19.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:18 trial106 ceph-mon[44052]: pgmap v820: 129 pgs: 129 active+clean; 423 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 237 op/s 2026-02-20T02:51:19.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:18 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:51:19.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58512480 4640.87 MB/sec execute 562 sec latency 4.194 ms 2026-02-20T02:51:19.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 158948 12.51 MB/sec execute 562 sec latency 41.005 ms 2026-02-20T02:51:20.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58604045 4641.42 MB/sec execute 563 sec latency 5.773 ms 2026-02-20T02:51:20.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 159251 12.52 MB/sec execute 563 sec latency 41.150 ms 2026-02-20T02:51:21.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:20 trial098 ceph-mon[38923]: pgmap v821: 129 pgs: 129 active+clean; 422 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.2 MiB/s wr, 250 op/s 2026-02-20T02:51:21.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:20 trial106 ceph-mon[44052]: pgmap v821: 129 pgs: 129 active+clean; 422 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.2 MiB/s wr, 250 op/s 2026-02-20T02:51:21.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58695270 4641.98 MB/sec execute 564 sec latency 4.579 ms 2026-02-20T02:51:21.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 159523 12.54 MB/sec execute 564 sec latency 43.240 ms 2026-02-20T02:51:22.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58784435 4642.40 MB/sec execute 565 sec latency 25.389 ms 2026-02-20T02:51:22.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 159786 12.56 MB/sec execute 565 sec latency 52.448 ms 2026-02-20T02:51:23.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:22 trial098 ceph-mon[38923]: pgmap v822: 129 pgs: 129 active+clean; 428 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 255 op/s 2026-02-20T02:51:23.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:22 trial106 ceph-mon[44052]: pgmap v822: 129 pgs: 129 active+clean; 428 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 255 op/s 2026-02-20T02:51:23.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58876356 4643.03 MB/sec execute 566 sec latency 2.785 ms 2026-02-20T02:51:23.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 159965 12.55 MB/sec execute 566 sec latency 54.896 ms 2026-02-20T02:51:24.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58948096 4641.66 MB/sec execute 567 sec latency 65.848 ms 2026-02-20T02:51:24.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 160144 12.55 MB/sec execute 567 sec latency 167.262 ms 2026-02-20T02:51:25.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:24 trial098 ceph-mon[38923]: pgmap v823: 129 pgs: 129 active+clean; 436 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 5.6 MiB/s wr, 234 op/s 2026-02-20T02:51:25.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:24 trial106 ceph-mon[44052]: pgmap v823: 129 pgs: 129 active+clean; 436 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 5.6 MiB/s wr, 234 op/s 2026-02-20T02:51:25.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 58949304 4633.61 MB/sec execute 568 sec latency 99.640 ms 2026-02-20T02:51:25.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 160227 12.53 MB/sec execute 568 sec latency 162.941 ms 2026-02-20T02:51:26.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59018696 4632.03 MB/sec execute 569 sec latency 75.179 ms 2026-02-20T02:51:26.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 160402 12.52 MB/sec execute 569 sec latency 146.494 ms 2026-02-20T02:51:27.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:26 trial106 ceph-mon[44052]: pgmap v824: 129 pgs: 129 active+clean; 444 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 6.1 MiB/s wr, 265 op/s 2026-02-20T02:51:27.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:26 trial098 ceph-mon[38923]: pgmap v824: 129 pgs: 129 active+clean; 444 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 6.1 MiB/s wr, 265 op/s 2026-02-20T02:51:27.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59112989 4632.89 MB/sec execute 570 sec latency 3.307 ms 2026-02-20T02:51:27.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 160605 12.51 MB/sec execute 570 sec latency 45.408 ms 2026-02-20T02:51:28.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59205230 4633.61 MB/sec execute 571 sec latency 5.507 ms 2026-02-20T02:51:28.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 160859 12.50 MB/sec execute 571 sec latency 50.757 ms 2026-02-20T02:51:29.116 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:28 trial098 ceph-mon[38923]: pgmap v825: 129 pgs: 129 active+clean; 447 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 252 op/s 2026-02-20T02:51:29.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:28 trial106 ceph-mon[44052]: pgmap v825: 129 pgs: 129 active+clean; 447 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 252 op/s 2026-02-20T02:51:29.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59295522 4634.09 MB/sec execute 572 sec latency 3.269 ms 2026-02-20T02:51:29.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 161141 12.51 MB/sec execute 572 sec latency 49.831 ms 2026-02-20T02:51:30.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 59384154 4634.38 MB/sec execute 573 sec latency 32.679 ms 2026-02-20T02:51:30.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 161382 12.51 MB/sec execute 573 sec latency 54.577 ms 2026-02-20T02:51:31.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:30 trial098 ceph-mon[38923]: pgmap v826: 129 pgs: 129 active+clean; 448 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 222 op/s 2026-02-20T02:51:31.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:30 trial106 ceph-mon[44052]: pgmap v826: 129 pgs: 129 active+clean; 448 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 6.0 MiB/s wr, 222 op/s 2026-02-20T02:51:31.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59425349 4630.18 MB/sec execute 574 sec latency 129.727 ms 2026-02-20T02:51:31.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 161551 12.50 MB/sec execute 574 sec latency 140.293 ms 2026-02-20T02:51:32.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59517120 4630.75 MB/sec execute 575 sec latency 28.153 ms 2026-02-20T02:51:32.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 161801 12.49 MB/sec execute 575 sec latency 78.490 ms 2026-02-20T02:51:33.316 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:32 trial098 ceph-mon[38923]: pgmap v827: 129 pgs: 129 active+clean; 438 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 212 op/s 2026-02-20T02:51:33.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:32 trial106 ceph-mon[44052]: pgmap v827: 129 pgs: 129 active+clean; 438 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 212 op/s 2026-02-20T02:51:33.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 59611027 4631.57 MB/sec execute 576 sec latency 25.895 ms 2026-02-20T02:51:33.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 162033 12.48 MB/sec execute 576 sec latency 42.686 ms 2026-02-20T02:51:34.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:51:34.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:33 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:51:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:51:34.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:33 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T02:51:34.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59702248 4632.20 MB/sec execute 577 sec latency 3.241 ms 2026-02-20T02:51:34.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 162299 12.49 MB/sec execute 577 sec latency 43.619 ms 2026-02-20T02:51:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:34 trial098 ceph-mon[38923]: pgmap v828: 129 pgs: 129 active+clean; 432 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.9 MiB/s wr, 253 op/s 2026-02-20T02:51:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:51:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:51:35.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:34 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:51:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:34 trial106 ceph-mon[44052]: pgmap v828: 129 pgs: 129 active+clean; 432 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.9 MiB/s wr, 253 op/s 2026-02-20T02:51:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T02:51:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T02:51:35.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:34 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' 2026-02-20T02:51:35.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59793927 4632.80 MB/sec execute 578 sec latency 5.409 ms 2026-02-20T02:51:35.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 162646 12.51 MB/sec execute 578 sec latency 49.562 ms 2026-02-20T02:51:36.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 59885713 4633.35 MB/sec execute 579 sec latency 4.173 ms 2026-02-20T02:51:36.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 162897 12.53 MB/sec execute 579 sec latency 46.117 ms 2026-02-20T02:51:37.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:36 trial106 ceph-mon[44052]: pgmap v829: 129 pgs: 129 active+clean; 435 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.1 MiB/s wr, 268 op/s 2026-02-20T02:51:37.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:36 trial098 ceph-mon[38923]: pgmap v829: 129 pgs: 129 active+clean; 435 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.1 MiB/s wr, 268 op/s 2026-02-20T02:51:37.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 59976724 4633.86 MB/sec execute 580 sec latency 4.297 ms 2026-02-20T02:51:37.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 163205 12.55 MB/sec execute 580 sec latency 46.857 ms 2026-02-20T02:51:38.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60068261 4634.42 MB/sec execute 581 sec latency 3.456 ms 2026-02-20T02:51:38.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 163387 12.54 MB/sec execute 581 sec latency 58.733 ms 2026-02-20T02:51:39.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:38 trial098 ceph-mon[38923]: pgmap v830: 129 pgs: 129 active+clean; 440 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 234 op/s 2026-02-20T02:51:39.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:38 trial106 ceph-mon[44052]: pgmap v830: 129 pgs: 129 active+clean; 440 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 234 op/s 2026-02-20T02:51:39.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60158245 4634.95 MB/sec execute 582 sec latency 5.193 ms 2026-02-20T02:51:39.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 163588 12.54 MB/sec execute 582 sec latency 42.675 ms 2026-02-20T02:51:40.521 INFO:tasks.workunit.client.0.trial098.stdout: 10 60246152 4635.19 MB/sec execute 583 sec latency 41.878 ms 2026-02-20T02:51:40.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 163781 12.53 MB/sec execute 583 sec latency 62.810 ms 2026-02-20T02:51:41.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:40 trial098 ceph-mon[38923]: pgmap v831: 129 pgs: 129 active+clean; 445 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 5.5 MiB/s wr, 248 op/s 2026-02-20T02:51:41.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:40 trial106 ceph-mon[44052]: pgmap v831: 129 pgs: 129 active+clean; 445 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 5.5 MiB/s wr, 248 op/s 2026-02-20T02:51:41.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60335345 4635.48 MB/sec execute 584 sec latency 20.403 ms 2026-02-20T02:51:41.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 163989 12.52 MB/sec execute 584 sec latency 58.862 ms 2026-02-20T02:51:42.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60421463 4635.50 MB/sec execute 585 sec latency 50.255 ms 2026-02-20T02:51:42.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 164192 12.51 MB/sec execute 585 sec latency 77.039 ms 2026-02-20T02:51:43.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:42 trial098 ceph-mon[38923]: pgmap v832: 129 pgs: 129 active+clean; 431 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 284 op/s 2026-02-20T02:51:43.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:42 trial106 ceph-mon[44052]: pgmap v832: 129 pgs: 129 active+clean; 431 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 284 op/s 2026-02-20T02:51:43.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60510112 4635.82 MB/sec execute 586 sec latency 4.062 ms 2026-02-20T02:51:43.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 164447 12.52 MB/sec execute 586 sec latency 58.677 ms 2026-02-20T02:51:44.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60603463 4636.61 MB/sec execute 587 sec latency 2.688 ms 2026-02-20T02:51:44.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 164716 12.52 MB/sec execute 587 sec latency 40.479 ms 2026-02-20T02:51:45.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:44 trial098 ceph-mon[38923]: pgmap v833: 129 pgs: 129 active+clean; 429 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.5 MiB/s wr, 256 op/s 2026-02-20T02:51:45.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:44 trial106 ceph-mon[44052]: pgmap v833: 129 pgs: 129 active+clean; 429 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.5 MiB/s wr, 256 op/s 2026-02-20T02:51:45.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60695474 4637.25 MB/sec execute 588 sec latency 3.261 ms 2026-02-20T02:51:45.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 164951 12.52 MB/sec execute 588 sec latency 47.310 ms 2026-02-20T02:51:46.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60785207 4637.60 MB/sec execute 589 sec latency 3.066 ms 2026-02-20T02:51:46.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 165199 12.51 MB/sec execute 589 sec latency 48.219 ms 2026-02-20T02:51:47.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:46 trial106 ceph-mon[44052]: pgmap v834: 129 pgs: 129 active+clean; 420 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.2 MiB/s wr, 231 op/s 2026-02-20T02:51:47.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:46 trial098 ceph-mon[38923]: pgmap v834: 129 pgs: 129 active+clean; 420 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.2 MiB/s wr, 231 op/s 2026-02-20T02:51:47.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60814885 4632.45 MB/sec execute 590 sec latency 117.283 ms 2026-02-20T02:51:47.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 165366 12.50 MB/sec execute 590 sec latency 161.505 ms 2026-02-20T02:51:48.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60838663 4626.77 MB/sec execute 591 sec latency 84.920 ms 2026-02-20T02:51:48.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 165486 12.48 MB/sec execute 591 sec latency 164.717 ms 2026-02-20T02:51:49.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:48 trial098 ceph-mon[38923]: pgmap v835: 129 pgs: 129 active+clean; 418 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 238 op/s 2026-02-20T02:51:49.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:48 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:51:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:48 trial106 ceph-mon[44052]: pgmap v835: 129 pgs: 129 active+clean; 418 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 238 op/s 2026-02-20T02:51:49.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:48 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:51:49.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 60931538 4627.47 MB/sec execute 592 sec latency 65.566 ms 2026-02-20T02:51:49.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 165711 12.47 MB/sec execute 592 sec latency 43.478 ms 2026-02-20T02:51:50.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 61020704 4627.89 MB/sec execute 593 sec latency 39.746 ms 2026-02-20T02:51:50.523 INFO:tasks.workunit.client.1.trial106.stdout: 10 166014 12.50 MB/sec execute 593 sec latency 41.908 ms 2026-02-20T02:51:51.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:50 trial098 ceph-mon[38923]: pgmap v836: 129 pgs: 129 active+clean; 418 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 5.7 MiB/s wr, 267 op/s 2026-02-20T02:51:51.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:50 trial106 ceph-mon[44052]: pgmap v836: 129 pgs: 129 active+clean; 418 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.8 KiB/s rd, 5.7 MiB/s wr, 267 op/s 2026-02-20T02:51:51.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 61111280 4628.41 MB/sec execute 594 sec latency 17.713 ms 2026-02-20T02:51:51.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 166331 12.51 MB/sec execute 594 sec latency 40.436 ms 2026-02-20T02:51:52.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 61201101 4628.79 MB/sec execute 595 sec latency 4.660 ms 2026-02-20T02:51:52.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 166593 12.52 MB/sec execute 595 sec latency 45.613 ms 2026-02-20T02:51:53.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:52 trial098 ceph-mon[38923]: pgmap v837: 129 pgs: 129 active+clean; 422 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 273 op/s 2026-02-20T02:51:53.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:52 trial106 ceph-mon[44052]: pgmap v837: 129 pgs: 129 active+clean; 422 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 273 op/s 2026-02-20T02:51:53.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 61293608 4629.40 MB/sec execute 596 sec latency 3.771 ms 2026-02-20T02:51:53.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 166870 12.55 MB/sec execute 596 sec latency 45.939 ms 2026-02-20T02:51:54.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 61386887 4630.12 MB/sec execute 597 sec latency 3.864 ms 2026-02-20T02:51:54.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 167050 12.54 MB/sec execute 597 sec latency 53.719 ms 2026-02-20T02:51:55.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:54 trial098 ceph-mon[38923]: pgmap v838: 129 pgs: 129 active+clean; 433 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 231 op/s 2026-02-20T02:51:55.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:54 trial106 ceph-mon[44052]: pgmap v838: 129 pgs: 129 active+clean; 433 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 5.3 MiB/s wr, 231 op/s 2026-02-20T02:51:55.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 61475737 4630.50 MB/sec execute 598 sec latency 3.343 ms 2026-02-20T02:51:55.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 167256 12.54 MB/sec execute 598 sec latency 46.152 ms 2026-02-20T02:51:56.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 61567565 4631.12 MB/sec execute 599 sec latency 5.923 ms 2026-02-20T02:51:56.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 167452 12.53 MB/sec execute 599 sec latency 58.397 ms 2026-02-20T02:51:57.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:56 trial106 ceph-mon[44052]: pgmap v839: 129 pgs: 129 active+clean; 438 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 5.5 MiB/s wr, 236 op/s 2026-02-20T02:51:57.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:56 trial098 ceph-mon[38923]: pgmap v839: 129 pgs: 129 active+clean; 438 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 5.5 MiB/s wr, 236 op/s 2026-02-20T02:51:57.522 INFO:tasks.workunit.client.0.trial098.stdout: 10 cleanup 600 sec 2026-02-20T02:51:57.524 INFO:tasks.workunit.client.1.trial106.stdout: 10 cleanup 600 sec 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: 0 cleanup 600 sec 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Operation Count AvgLat MaxLat 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: ---------------------------------------- 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: NTCreateX 88495027 0.014 53.193 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Close 65005960 0.001 2.441 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Rename 3747307 0.043 43.448 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Unlink 17870887 0.035 57.099 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Deltree 2242 3.056 25.397 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Mkdir 1121 0.003 0.034 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Qpathinfo 80211679 0.005 40.438 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Qfileinfo 14056917 0.001 2.596 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Qfsinfo 14707759 0.002 4.215 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Sfileinfo 7208690 0.009 53.274 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Find 31011766 0.015 35.782 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: WriteX 44122718 0.012 50.612 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: ReadX 138722069 0.002 53.239 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: LockX 288168 0.002 1.365 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: UnlockX 288168 0.001 1.579 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: Flush 6202329 0.277 166.164 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout: 2026-02-20T02:51:57.530 INFO:tasks.workunit.client.0.trial098.stdout:Throughput 4631.12 MB/sec 10 clients 10 procs max_latency=166.171 ms 2026-02-20T02:51:57.531 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-20T02:51:57.531 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-20T02:51:57.603 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2026-02-20T02:51:57.603 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-20T02:51:57.962 DEBUG:teuthology.parallel:result is None 2026-02-20T02:51:58.210 INFO:tasks.workunit.client.1.trial106.stdout: 0 cleanup 601 sec 2026-02-20T02:51:58.210 INFO:tasks.workunit.client.1.trial106.stdout: 2026-02-20T02:51:58.210 INFO:tasks.workunit.client.1.trial106.stdout: Operation Count AvgLat MaxLat 2026-02-20T02:51:58.210 INFO:tasks.workunit.client.1.trial106.stdout: ---------------------------------------- 2026-02-20T02:51:58.210 INFO:tasks.workunit.client.1.trial106.stdout: NTCreateX 241606 6.928 174.536 2026-02-20T02:51:58.210 INFO:tasks.workunit.client.1.trial106.stdout: Close 177094 0.123 4.980 2026-02-20T02:51:58.210 INFO:tasks.workunit.client.1.trial106.stdout: Rename 10208 14.840 116.585 2026-02-20T02:51:58.210 INFO:tasks.workunit.client.1.trial106.stdout: Unlink 49063 5.631 123.890 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: Qpathinfo 218782 3.814 169.062 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: Qfileinfo 37994 0.256 2.849 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: Qfsinfo 40156 0.540 5.919 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: Sfileinfo 19617 1.994 7.801 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: Find 84399 33.639 234.469 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: WriteX 119004 0.392 26.080 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: ReadX 377275 0.004 1.850 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: LockX 780 1.657 29.014 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: UnlockX 780 1.328 12.216 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: Flush 16916 4.710 139.295 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout: 2026-02-20T02:51:58.211 INFO:tasks.workunit.client.1.trial106.stdout:Throughput 12.5252 MB/sec 10 clients 10 procs max_latency=234.473 ms 2026-02-20T02:51:58.212 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-20T02:51:58.212 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2026-02-20T02:51:58.599 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.1... 2026-02-20T02:51:58.599 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2026-02-20T02:51:58.852 DEBUG:teuthology.parallel:result is None 2026-02-20T02:51:58.852 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T02:51:58.879 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T02:51:58.879 DEBUG:teuthology.orchestra.run.trial098:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-20T02:51:58.935 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T02:51:58.935 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2026-02-20T02:51:58.966 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2026-02-20T02:51:58.966 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T02:51:58.985 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T02:51:58.986 DEBUG:teuthology.orchestra.run.trial098:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T02:51:58.987 DEBUG:teuthology.orchestra.run.trial106:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T02:51:58.989 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial098.front.sepia.ceph.com 2026-02-20T02:51:58.990 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-20T02:51:58.990 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-20T02:51:59.008 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial106.front.sepia.ceph.com 2026-02-20T02:51:59.008 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-20T02:51:59.009 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-20T02:51:59.117 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:51:58 trial106 ceph-mon[44052]: pgmap v840: 129 pgs: 129 active+clean; 442 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.9 MiB/s wr, 229 op/s 2026-02-20T02:51:59.193 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:51:58 trial098 ceph-mon[38923]: pgmap v840: 129 pgs: 129 active+clean; 442 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 5.9 MiB/s wr, 229 op/s 2026-02-20T02:51:59.304 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:51:59.305 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:51:59.305 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout:Removing: 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout: nvme-cli x86_64 2.16-1.el9 @baseos 7.0 M 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout:Remove 1 Package 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout:Freed space: 7.0 M 2026-02-20T02:51:59.306 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:51:59.309 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:51:59.309 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:51:59.329 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:51:59.329 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:51:59.330 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:51:59.330 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:51:59.330 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout:Removing: 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli x86_64 2.16-1.el9 @baseos 7.0 M 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout:Remove 1 Package 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout:Freed space: 7.0 M 2026-02-20T02:51:59.331 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:51:59.335 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:51:59.335 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:51:59.358 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:51:59.358 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:51:59.385 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:51:59.412 INFO:teuthology.orchestra.run.trial098.stdout: Erasing : nvme-cli-2.16-1.el9.x86_64 1/1 2026-02-20T02:51:59.417 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:51:59.434 INFO:teuthology.orchestra.run.trial106.stdout: Erasing : nvme-cli-2.16-1.el9.x86_64 1/1 2026-02-20T02:51:59.944 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 1/1 2026-02-20T02:51:59.991 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/1 2026-02-20T02:51:59.991 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:51:59.991 INFO:teuthology.orchestra.run.trial106.stdout:Removed: 2026-02-20T02:51:59.991 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T02:51:59.991 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:51:59.991 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:52:00.316 INFO:teuthology.orchestra.run.trial106.stdout:Last metadata expiration check: 0:28:00 ago on Fri 20 Feb 2026 02:24:00 AM UTC. 2026-02-20T02:52:00.411 INFO:teuthology.orchestra.run.trial106.stdout:Dependencies resolved. 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout: Package Architecture Version Repository Size 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout:Installing: 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout:Installing dependencies: 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-20T02:52:00.412 INFO:teuthology.orchestra.run.trial106.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-20T02:52:00.413 INFO:teuthology.orchestra.run.trial106.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-20T02:52:00.413 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:52:00.413 INFO:teuthology.orchestra.run.trial106.stdout:Transaction Summary 2026-02-20T02:52:00.413 INFO:teuthology.orchestra.run.trial106.stdout:================================================================================ 2026-02-20T02:52:00.413 INFO:teuthology.orchestra.run.trial106.stdout:Install 5 Packages 2026-02-20T02:52:00.413 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:52:00.414 INFO:teuthology.orchestra.run.trial106.stdout:Total download size: 2.2 M 2026-02-20T02:52:00.414 INFO:teuthology.orchestra.run.trial106.stdout:Installed size: 11 M 2026-02-20T02:52:00.414 INFO:teuthology.orchestra.run.trial106.stdout:Downloading Packages: 2026-02-20T02:52:00.929 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 1/1 2026-02-20T02:52:00.976 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/1 2026-02-20T02:52:00.976 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:52:00.976 INFO:teuthology.orchestra.run.trial098.stdout:Removed: 2026-02-20T02:52:00.976 INFO:teuthology.orchestra.run.trial098.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T02:52:00.977 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:52:00.977 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:52:00.996 INFO:teuthology.orchestra.run.trial106.stdout:(1/5): python3-configshell-1.1.30-1.el9.noarch. 139 kB/s | 72 kB 00:00 2026-02-20T02:52:01.018 INFO:teuthology.orchestra.run.trial106.stdout:(2/5): nvmetcli-0.8-3.el9.noarch.rpm 81 kB/s | 44 kB 00:00 2026-02-20T02:52:01.184 INFO:teuthology.orchestra.run.trial106.stdout:(3/5): python3-kmod-0.9-32.el9.x86_64.rpm 448 kB/s | 84 kB 00:00 2026-02-20T02:52:01.299 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:28:10 ago on Fri 20 Feb 2026 02:23:51 AM UTC. 2026-02-20T02:52:01.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:00 trial098 ceph-mon[38923]: pgmap v841: 129 pgs: 129 active+clean; 447 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 6.2 MiB/s wr, 241 op/s 2026-02-20T02:52:01.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:00 trial106 ceph-mon[44052]: pgmap v841: 129 pgs: 129 active+clean; 447 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 6.2 MiB/s wr, 241 op/s 2026-02-20T02:52:01.391 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-20T02:52:01.391 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:52:01.391 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout:Installing dependencies: 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-20T02:52:01.392 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-20T02:52:01.393 INFO:teuthology.orchestra.run.trial098.stdout:Install 5 Packages 2026-02-20T02:52:01.393 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:52:01.393 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 2.2 M 2026-02-20T02:52:01.393 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 11 M 2026-02-20T02:52:01.393 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-20T02:52:01.474 INFO:teuthology.orchestra.run.trial098.stdout:(1/5): nvmetcli-0.8-3.el9.noarch.rpm 3.1 MB/s | 44 kB 00:00 2026-02-20T02:52:01.475 INFO:teuthology.orchestra.run.trial098.stdout:(2/5): python3-configshell-1.1.30-1.el9.noarch. 4.8 MB/s | 72 kB 00:00 2026-02-20T02:52:01.483 INFO:teuthology.orchestra.run.trial098.stdout:(3/5): python3-kmod-0.9-32.el9.x86_64.rpm 9.7 MB/s | 84 kB 00:00 2026-02-20T02:52:01.490 INFO:teuthology.orchestra.run.trial098.stdout:(4/5): nvme-cli-2.16-1.el9.x86_64.rpm 39 MB/s | 1.2 MB 00:00 2026-02-20T02:52:01.492 INFO:teuthology.orchestra.run.trial098.stdout:(5/5): python3-urwid-2.1.2-4.el9.x86_64.rpm 48 MB/s | 837 kB 00:00 2026-02-20T02:52:01.492 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:52:01.492 INFO:teuthology.orchestra.run.trial098.stdout:Total 22 MB/s | 2.2 MB 00:00 2026-02-20T02:52:01.538 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-20T02:52:01.546 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-20T02:52:01.547 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-20T02:52:01.610 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-20T02:52:01.611 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-20T02:52:01.749 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-20T02:52:01.762 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/5 2026-02-20T02:52:01.767 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/5 2026-02-20T02:52:01.773 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/5 2026-02-20T02:52:01.774 INFO:teuthology.orchestra.run.trial098.stdout: Installing : nvmetcli-0.8-3.el9.noarch 4/5 2026-02-20T02:52:01.906 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 4/5 2026-02-20T02:52:01.908 INFO:teuthology.orchestra.run.trial098.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 5/5 2026-02-20T02:52:01.984 INFO:teuthology.orchestra.run.trial106.stdout:(4/5): python3-urwid-2.1.2-4.el9.x86_64.rpm 867 kB/s | 837 kB 00:00 2026-02-20T02:52:02.255 INFO:teuthology.orchestra.run.trial106.stdout:(5/5): nvme-cli-2.16-1.el9.x86_64.rpm 664 kB/s | 1.2 MB 00:01 2026-02-20T02:52:02.257 INFO:teuthology.orchestra.run.trial106.stdout:-------------------------------------------------------------------------------- 2026-02-20T02:52:02.258 INFO:teuthology.orchestra.run.trial106.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2026-02-20T02:52:02.302 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction check 2026-02-20T02:52:02.311 INFO:teuthology.orchestra.run.trial106.stdout:Transaction check succeeded. 2026-02-20T02:52:02.312 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction test 2026-02-20T02:52:02.381 INFO:teuthology.orchestra.run.trial106.stdout:Transaction test succeeded. 2026-02-20T02:52:02.381 INFO:teuthology.orchestra.run.trial106.stdout:Running transaction 2026-02-20T02:52:02.523 INFO:teuthology.orchestra.run.trial106.stdout: Preparing : 1/1 2026-02-20T02:52:02.536 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/5 2026-02-20T02:52:02.541 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 5/5 2026-02-20T02:52:02.541 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/5 2026-02-20T02:52:02.541 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/5 2026-02-20T02:52:02.541 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/5 2026-02-20T02:52:02.541 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/5 2026-02-20T02:52:02.542 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/5 2026-02-20T02:52:02.548 INFO:teuthology.orchestra.run.trial106.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/5 2026-02-20T02:52:02.549 INFO:teuthology.orchestra.run.trial106.stdout: Installing : nvmetcli-0.8-3.el9.noarch 4/5 2026-02-20T02:52:02.601 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 5/5 2026-02-20T02:52:02.602 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:52:02.602 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-20T02:52:02.602 INFO:teuthology.orchestra.run.trial098.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-20T02:52:02.602 INFO:teuthology.orchestra.run.trial098.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-20T02:52:02.602 INFO:teuthology.orchestra.run.trial098.stdout: python3-urwid-2.1.2-4.el9.x86_64 2026-02-20T02:52:02.602 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-20T02:52:02.602 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-20T02:52:02.632 DEBUG:teuthology.parallel:result is None 2026-02-20T02:52:02.679 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 4/5 2026-02-20T02:52:02.681 INFO:teuthology.orchestra.run.trial106.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 5/5 2026-02-20T02:52:03.248 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:02 trial106 ceph-mon[44052]: pgmap v842: 129 pgs: 129 active+clean; 390 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 221 op/s 2026-02-20T02:52:03.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:02 trial098 ceph-mon[38923]: pgmap v842: 129 pgs: 129 active+clean; 390 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 221 op/s 2026-02-20T02:52:03.320 INFO:teuthology.orchestra.run.trial106.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 5/5 2026-02-20T02:52:03.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/5 2026-02-20T02:52:03.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/5 2026-02-20T02:52:03.320 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/5 2026-02-20T02:52:03.321 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/5 2026-02-20T02:52:03.382 INFO:teuthology.orchestra.run.trial106.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 5/5 2026-02-20T02:52:03.382 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:52:03.382 INFO:teuthology.orchestra.run.trial106.stdout:Installed: 2026-02-20T02:52:03.383 INFO:teuthology.orchestra.run.trial106.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-20T02:52:03.383 INFO:teuthology.orchestra.run.trial106.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-20T02:52:03.383 INFO:teuthology.orchestra.run.trial106.stdout: python3-urwid-2.1.2-4.el9.x86_64 2026-02-20T02:52:03.383 INFO:teuthology.orchestra.run.trial106.stdout: 2026-02-20T02:52:03.383 INFO:teuthology.orchestra.run.trial106.stdout:Complete! 2026-02-20T02:52:03.411 DEBUG:teuthology.parallel:result is None 2026-02-20T02:52:03.412 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2026-02-20T02:52:03.424 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2026-02-20T02:52:03.424 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:52:03.424 DEBUG:teuthology.orchestra.run.trial106:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T02:52:03.445 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:52:03.445 DEBUG:teuthology.orchestra.run.trial106:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T02:52:03.506 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd blocklist ls 2026-02-20T02:52:03.666 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:52:03.778 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.774+0000 7fa4c4deb640 1 -- 10.20.193.98:0/966619565 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 msgr2=0x7fa4c010ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:52:03.778 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.774+0000 7fa4c4deb640 1 --2- 10.20.193.98:0/966619565 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 0x7fa4c010ad00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40099b0 tx=0x7fa4b402f220 comp rx=0 tx=0).stop 2026-02-20T02:52:03.778 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.774+0000 7fa4c4deb640 1 -- 10.20.193.98:0/966619565 shutdown_connections 2026-02-20T02:52:03.778 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.774+0000 7fa4c4deb640 1 --2- 10.20.193.98:0/966619565 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa4c0104920 0x7fa4c0104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:03.778 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.774+0000 7fa4c4deb640 1 --2- 10.20.193.98:0/966619565 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 0x7fa4c010ad00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:03.778 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.774+0000 7fa4c4deb640 1 -- 10.20.193.98:0/966619565 >> 10.20.193.98:0/966619565 conn(0x7fa4c0100620 msgr2=0x7fa4c0102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.774+0000 7fa4c4deb640 1 -- 10.20.193.98:0/966619565 shutdown_connections 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.774+0000 7fa4c4deb640 1 -- 10.20.193.98:0/966619565 wait complete. 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4c4deb640 1 Processor -- start 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4c4deb640 1 -- start start 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4c4deb640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa4c0104920 0x7fa4c01a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4c4deb640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 0x7fa4c01a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4c4deb640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0111b40 con 0x7fa4c010a920 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4c4deb640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c01119c0 con 0x7fa4c0104920 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4bdd74640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 0x7fa4c01a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4bdd74640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 0x7fa4c01a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:50442/0 (socket says 10.20.193.98:50442) 2026-02-20T02:52:03.779 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4bdd74640 1 -- 10.20.193.98:0/2894010498 learned_addr learned my addr 10.20.193.98:0/2894010498 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4be575640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa4c0104920 0x7fa4c01a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4bdd74640 1 -- 10.20.193.98:0/2894010498 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa4c0104920 msgr2=0x7fa4c01a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4bdd74640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa4c0104920 0x7fa4c01a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4bdd74640 1 -- 10.20.193.98:0/2894010498 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c019c6f0 con 0x7fa4c010a920 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4bdd74640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 0x7fa4c01a2b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800d8d0 tx=0x7fa4a800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4a77fe640 1 -- 10.20.193.98:0/2894010498 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa4a8014070 con 0x7fa4c010a920 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.775+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c019c9e0 con 0x7fa4c010a920 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.776+0000 7fa4a77fe640 1 -- 10.20.193.98:0/2894010498 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa4a80044a0 con 0x7fa4c010a920 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.776+0000 7fa4a77fe640 1 -- 10.20.193.98:0/2894010498 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fa4a8002dc0 con 0x7fa4c010a920 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.776+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c019cf40 con 0x7fa4c010a920 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.776+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c0106060 con 0x7fa4c010a920 2026-02-20T02:52:03.780 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.777+0000 7fa4a77fe640 1 -- 10.20.193.98:0/2894010498 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fa4a800b840 con 0x7fa4c010a920 2026-02-20T02:52:03.781 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.777+0000 7fa4a77fe640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa498077550 0x7fa498079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:52:03.782 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.777+0000 7fa4a77fe640 1 -- 10.20.193.98:0/2894010498 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 7336+0+0 (secure 0 0 0) 0x7fa4a809a1f0 con 0x7fa4c010a920 2026-02-20T02:52:03.782 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.777+0000 7fa4be575640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa498077550 0x7fa498079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:52:03.782 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.777+0000 7fa4be575640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa498077550 0x7fa498079a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4002410 tx=0x7fa4b403a040 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:52:03.782 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.779+0000 7fa4a77fe640 1 -- 10.20.193.98:0/2894010498 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa4a8066b50 con 0x7fa4c010a920 2026-02-20T02:52:03.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.869+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4c0104d80 con 0x7fa4c010a920 2026-02-20T02:52:03.871 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.870+0000 7fa4a77fe640 1 -- 10.20.193.98:0/2894010498 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v60) ==== 81+0+999 (secure 0 0 0) 0x7fa4a806ba00 con 0x7fa4c010a920 2026-02-20T02:52:03.872 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/2186036449 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:03.872 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/892283834 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:03.872 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/4072581924 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:03.872 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6834/390933865 2026-02-21T02:27:21.531921+0000 2026-02-20T02:52:03.872 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/757881106 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:03.872 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/802451532 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:03.872 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/802451532 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/2682971939 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/180891152 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6835/390933865 2026-02-21T02:27:21.531921+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/494053877 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/635628968 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/433631514 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/3304232391 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/2682971939 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/892283834 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:03.873 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/3223427167 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:03.874 INFO:teuthology.orchestra.run.trial098.stderr:listed 17 entries 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa498077550 msgr2=0x7fa498079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa498077550 0x7fa498079a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4002410 tx=0x7fa4b403a040 comp rx=0 tx=0).stop 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 msgr2=0x7fa4c01a2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 0x7fa4c01a2b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800d8d0 tx=0x7fa4a800dda0 comp rx=0 tx=0).stop 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 shutdown_connections 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fa498077550 0x7fa498079a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fa4c010a920 0x7fa4c01a2b60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 --2- 10.20.193.98:0/2894010498 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fa4c0104920 0x7fa4c01a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 >> 10.20.193.98:0/2894010498 conn(0x7fa4c0100620 msgr2=0x7fa4c0102760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 shutdown_connections 2026-02-20T02:52:03.875 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:03.871+0000 7fa4c4deb640 1 -- 10.20.193.98:0/2894010498 wait complete. 2026-02-20T02:52:03.911 DEBUG:teuthology.orchestra.run.trial106:> set -ex 2026-02-20T02:52:03.911 DEBUG:teuthology.orchestra.run.trial106:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T02:52:03.933 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph osd blocklist ls 2026-02-20T02:52:04.064 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:03 trial098 ceph-mon[38923]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:52:04.065 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:03 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/2894010498' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T02:52:04.090 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:52:04.197 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 -- 10.20.193.98:0/2469502532 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 msgr2=0x7fdf6010acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 --2- 10.20.193.98:0/2469502532 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 0x7fdf6010acc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdf500099b0 tx=0x7fdf5002f220 comp rx=0 tx=0).stop 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 -- 10.20.193.98:0/2469502532 shutdown_connections 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 --2- 10.20.193.98:0/2469502532 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fdf601048e0 0x7fdf60104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 --2- 10.20.193.98:0/2469502532 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 0x7fdf6010acc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 -- 10.20.193.98:0/2469502532 >> 10.20.193.98:0/2469502532 conn(0x7fdf60100580 msgr2=0x7fdf601029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 -- 10.20.193.98:0/2469502532 shutdown_connections 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 -- 10.20.193.98:0/2469502532 wait complete. 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 Processor -- start 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 -- start start 2026-02-20T02:52:04.198 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 --2- >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fdf601048e0 0x7fdf601a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 0x7fdf601a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 -- --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60111b00 con 0x7fdf6010a8e0 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.193+0000 7fdf68034640 1 -- --> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60111980 con 0x7fdf601048e0 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf655a8640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 0x7fdf601a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf655a8640 1 --2- >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 0x7fdf601a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.98:3300/0 says I am v2:10.20.193.98:50470/0 (socket says 10.20.193.98:50470) 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf655a8640 1 -- 10.20.193.98:0/185745289 learned_addr learned my addr 10.20.193.98:0/185745289 (peer_addr_for_me v2:10.20.193.98:0/0) 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf65da9640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fdf601048e0 0x7fdf601a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf655a8640 1 -- 10.20.193.98:0/185745289 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fdf601048e0 msgr2=0x7fdf601a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf655a8640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fdf601048e0 0x7fdf601a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf655a8640 1 -- 10.20.193.98:0/185745289 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6019c650 con 0x7fdf6010a8e0 2026-02-20T02:52:04.199 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf655a8640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 0x7fdf601a2ac0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400d8d0 tx=0x7fdf5400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf4effd640 1 -- 10.20.193.98:0/185745289 <== mon.0 v2:10.20.193.98:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fdf54014070 con 0x7fdf6010a8e0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf4effd640 1 -- 10.20.193.98:0/185745289 <== mon.0 v2:10.20.193.98:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fdf540044a0 con 0x7fdf6010a8e0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf4effd640 1 -- 10.20.193.98:0/185745289 <== mon.0 v2:10.20.193.98:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fdf54002dc0 con 0x7fdf6010a8e0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6019c940 con 0x7fdf6010a8e0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.194+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6019cea0 con 0x7fdf6010a8e0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.195+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf60106020 con 0x7fdf6010a8e0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.195+0000 7fdf4effd640 1 -- 10.20.193.98:0/185745289 <== mon.0 v2:10.20.193.98:3300/0 4 ==== mgrmap(e 19) ==== 100117+0+0 (secure 0 0 0) 0x7fdf5400b840 con 0x7fdf6010a8e0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.196+0000 7fdf4effd640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fdf3c077550 0x7fdf3c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.196+0000 7fdf65da9640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fdf3c077550 0x7fdf3c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.196+0000 7fdf4effd640 1 -- 10.20.193.98:0/185745289 <== mon.0 v2:10.20.193.98:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 7336+0+0 (secure 0 0 0) 0x7fdf5409a170 con 0x7fdf6010a8e0 2026-02-20T02:52:04.200 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.196+0000 7fdf65da9640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fdf3c077550 0x7fdf3c079a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdf50005ec0 tx=0x7fdf50005e50 comp rx=0 tx=0).ready entity=mgr.14205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T02:52:04.201 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.198+0000 7fdf4effd640 1 -- 10.20.193.98:0/185745289 <== mon.0 v2:10.20.193.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fdf54066a50 con 0x7fdf6010a8e0 2026-02-20T02:52:04.289 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.288+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 --> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdf60104d40 con 0x7fdf6010a8e0 2026-02-20T02:52:04.290 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.288+0000 7fdf4effd640 1 -- 10.20.193.98:0/185745289 <== mon.0 v2:10.20.193.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v60) ==== 81+0+999 (secure 0 0 0) 0x7fdf5406b900 con 0x7fdf6010a8e0 2026-02-20T02:52:04.290 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/2186036449 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:04.290 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/892283834 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:04.290 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/4072581924 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6834/390933865 2026-02-21T02:27:21.531921+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/757881106 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/802451532 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/802451532 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6801/2682971939 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/180891152 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6835/390933865 2026-02-21T02:27:21.531921+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/494053877 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/635628968 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/433631514 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/3304232391 2026-02-21T02:25:05.975323+0000 2026-02-20T02:52:04.291 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/2682971939 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:04.292 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:6800/892283834 2026-02-21T02:25:33.491288+0000 2026-02-20T02:52:04.292 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98:0/3223427167 2026-02-21T02:25:15.462934+0000 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:listed 17 entries 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fdf3c077550 msgr2=0x7fdf3c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fdf3c077550 0x7fdf3c079a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdf50005ec0 tx=0x7fdf50005e50 comp rx=0 tx=0).stop 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 msgr2=0x7fdf601a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 0x7fdf601a2ac0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400d8d0 tx=0x7fdf5400dda0 comp rx=0 tx=0).stop 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 shutdown_connections 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:6800/4172434185,v1:10.20.193.98:6801/4172434185] conn(0x7fdf3c077550 0x7fdf3c079a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.98:3300/0,v1:10.20.193.98:6789/0] conn(0x7fdf6010a8e0 0x7fdf601a2ac0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 --2- 10.20.193.98:0/185745289 >> [v2:10.20.193.106:3300/0,v1:10.20.193.106:6789/0] conn(0x7fdf601048e0 0x7fdf601a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T02:52:04.293 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 >> 10.20.193.98:0/185745289 conn(0x7fdf60100580 msgr2=0x7fdf60102730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T02:52:04.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 shutdown_connections 2026-02-20T02:52:04.294 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-20T02:52:04.289+0000 7fdf68034640 1 -- 10.20.193.98:0/185745289 wait complete. 2026-02-20T02:52:04.326 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@trial106.front.sepia.ceph.com... 2026-02-20T02:52:04.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:52:04.326 DEBUG:teuthology.orchestra.run.trial106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2026-02-20T02:52:04.349 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:03 trial106 ceph-mon[44052]: from='mgr.14205 10.20.193.98:0/669169727' entity='mgr.trial098.hiicxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-20T02:52:04.349 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:03 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/2894010498' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T02:52:04.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.trial106.stderr:ceph-fuse[71518]: fuse finished with error 0 and tester_r 0 2026-02-20T02:52:04.354 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T02:52:05.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:04 trial098 ceph-mon[38923]: pgmap v843: 129 pgs: 129 active+clean; 281 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 215 op/s 2026-02-20T02:52:05.315 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:04 trial098 ceph-mon[38923]: from='client.? 10.20.193.98:0/185745289' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T02:52:05.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:04 trial106 ceph-mon[44052]: pgmap v843: 129 pgs: 129 active+clean; 281 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 215 op/s 2026-02-20T02:52:05.368 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:04 trial106 ceph-mon[44052]: from='client.? 10.20.193.98:0/185745289' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T02:52:07.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:06 trial098 ceph-mon[38923]: pgmap v844: 129 pgs: 129 active+clean; 229 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 15 KiB/s rd, 3.6 MiB/s wr, 212 op/s 2026-02-20T02:52:07.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:06 trial106 ceph-mon[44052]: pgmap v844: 129 pgs: 129 active+clean; 229 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 15 KiB/s rd, 3.6 MiB/s wr, 212 op/s 2026-02-20T02:52:09.314 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:08 trial098 ceph-mon[38923]: pgmap v845: 129 pgs: 129 active+clean; 229 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 15 KiB/s rd, 2.6 MiB/s wr, 187 op/s 2026-02-20T02:52:09.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:08 trial106 ceph-mon[44052]: pgmap v845: 129 pgs: 129 active+clean; 229 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 15 KiB/s rd, 2.6 MiB/s wr, 187 op/s 2026-02-20T02:52:10.455 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial106.front.sepia.ceph.com 2026-02-20T02:52:10.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:52:10.456 DEBUG:teuthology.orchestra.run.trial106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2026-02-20T02:52:10.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:52:10.475 DEBUG:teuthology.orchestra.run.trial106:> ip netns list 2026-02-20T02:52:10.531 INFO:teuthology.orchestra.run.trial106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2026-02-20T02:52:10.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:52:10.531 DEBUG:teuthology.orchestra.run.trial106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-20T02:52:10.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:52:10.598 DEBUG:teuthology.orchestra.run.trial106:> sudo ip link delete ceph-brx 2026-02-20T02:52:10.693 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2026-02-20T02:52:10.709 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2026-02-20T02:52:10.709 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-20T02:52:10.709 DEBUG:teuthology.orchestra.run.trial098:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T02:52:10.732 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=65182904k,nr_inodes=16295726,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=26087788k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 efivarfs /sys/firmware/efi/efivars efivarfs rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 /dev/nvme0n1p2 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=64 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/nvme0n1p1 /boot/efi vfat rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=ascii,shortname=mixed,errors=remount-ro 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=13043892k,nr_inodes=3260973,mode=700,uid=1000,gid=1002,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/nvme0n1p2 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/ab8ef0febf98445bc7723a2ce72dce5bd84019b75e7d3898a0bebc7dfd687a07/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/ab8ef0febf98445bc7723a2ce72dce5bd84019b75e7d3898a0bebc7dfd687a07/diff,workdir=/var/lib/containers/storage/overlay/ab8ef0febf98445bc7723a2ce72dce5bd84019b75e7d3898a0bebc7dfd687a07/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0adf2128477e82e1aa55bd2be74eaa1458d66f025d0b8c6b3e86a69c92325b4d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/0adf2128477e82e1aa55bd2be74eaa1458d66f025d0b8c6b3e86a69c92325b4d/diff,workdir=/var/lib/containers/storage/overlay/0adf2128477e82e1aa55bd2be74eaa1458d66f025d0b8c6b3e86a69c92325b4d/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=13043892k,nr_inodes=3260973,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/192755540d35b67de751c41f650df3ea98eece81b88dc7edfd3508f5137cf268/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/192755540d35b67de751c41f650df3ea98eece81b88dc7edfd3508f5137cf268/diff,workdir=/var/lib/containers/storage/overlay/192755540d35b67de751c41f650df3ea98eece81b88dc7edfd3508f5137cf268/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b106a4cf4c4a0749c5554468f08c26fbf37aa8124aff626206a9cd966e8653e4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/b106a4cf4c4a0749c5554468f08c26fbf37aa8124aff626206a9cd966e8653e4/diff,workdir=/var/lib/containers/storage/overlay/b106a4cf4c4a0749c5554468f08c26fbf37aa8124aff626206a9cd966e8653e4/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b86d14bfdeabf92bd01ecb7729cbc397f9cf135dfe16c468d456e13099ff544c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/2MM4QBM6SVPDZEJ44AFTUTKS7D:/var/lib/containers/storage/overlay/l/PXPXOVZOHXATTCLWITZYVGOFII:/var/lib/containers/storage/overlay/l/7VGJF37LGEHQBFHDFJ337QFJWP,upperdir=/var/lib/containers/storage/overlay/b86d14bfdeabf92bd01ecb7729cbc397f9cf135dfe16c468d456e13099ff544c/diff,workdir=/var/lib/containers/storage/overlay/b86d14bfdeabf92bd01ecb7729cbc397f9cf135dfe16c468d456e13099ff544c/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/95e4195ace8860c15ccda13a46412ae97c8ec43a4f6587f42b4dcb8258178c5a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/OFIHZYMZEXQZJ24WMXV4TRQEST:/var/lib/containers/storage/overlay/l/LTYESC662PSZFU4RTQTKZGQMG4:/var/lib/containers/storage/overlay/l/OPN4QNIPZHTVT7W3F4YSH3RMPN:/var/lib/containers/storage/overlay/l/ZCF6E3SMPP2VNC365FSY322IAG:/var/lib/containers/storage/overlay/l/7SZVQCULNEVSACKAAZMH6KSX22:/var/lib/containers/storage/overlay/l/KD3AJQTUCNBK5G2ECPHYBAB6AE,upperdir=/var/lib/containers/storage/overlay/95e4195ace8860c15ccda13a46412ae97c8ec43a4f6587f42b4dcb8258178c5a/diff,workdir=/var/lib/containers/storage/overlay/95e4195ace8860c15ccda13a46412ae97c8ec43a4f6587f42b4dcb8258178c5a/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f8a037ccec3e35748d06d5c929fa7c2c413545258d732dcaa9b0c2641d3ee964/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/PTMOBYOKFLYQW4EWCHFFHIWYFO:/var/lib/containers/storage/overlay/l/6TINOCDNPEU46NGWR5C3JH73YJ:/var/lib/containers/storage/overlay/l/5LJDII3U7VBZIQNKNDFK5PY7BN:/var/lib/containers/storage/overlay/l/3IAPSL4BL6NVNW57C6A735G7PH:/var/lib/containers/storage/overlay/l/5XZMT7JXD6RYTWIWCO2HQFBVIP:/var/lib/containers/storage/overlay/l/BSHDOZ4T6F52KHBTTYQL5TGZ5D:/var/lib/containers/storage/overlay/l/QDMSNPQTD7QU4RO5MGXPGNQJQO:/var/lib/containers/storage/overlay/l/RIRNRA3AVVUVBSD4QU6JX7LMNV:/var/lib/containers/storage/overlay/l/SZ4VISLHQFZMKGO3AMNHX44R4S:/var/lib/containers/storage/overlay/l/SLPQ6IAH4SHBVD5CLC4DZPERLS,upperdir=/var/lib/containers/storage/overlay/f8a037ccec3e35748d06d5c929fa7c2c413545258d732dcaa9b0c2641d3ee964/diff,workdir=/var/lib/containers/storage/overlay/f8a037ccec3e35748d06d5c929fa7c2c413545258d732dcaa9b0c2641d3ee964/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2eb1b52eeaba6df4d8bc186347fb5266eb3230701369be93ec2474639598d4fd/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/K4BPCMI3KFRMOUQWBKYE4PSA4Q:/var/lib/containers/storage/overlay/l/ZNTSG5RK4LE77COYKAWD3C2XU6:/var/lib/containers/storage/overlay/l/FYQBGHBQ547T7RV7WBLMR5UOGD:/var/lib/containers/storage/overlay/l/WL2UUZVNB7MF7NO6L6T7LI563X:/var/lib/containers/storage/overlay/l/GZNCDUY67IOHGAEP5DOAF2ERFU:/var/lib/containers/storage/overlay/l/6T67LLUZB5NHYPA3VYNEEHUM62:/var/lib/containers/storage/overlay/l/6HYTZ3Y7V3LMVQR3RAO2CAIWUF:/var/lib/containers/storage/overlay/l/VSX37SJKF3CLVHGXXKC4L32K3V:/var/lib/containers/storage/overlay/l/JECN3FAOMT2NGBZLRTEOQNTQ27:/var/lib/containers/storage/overlay/l/OBGNXYZ5NPISYXLSGQQ6WSWWDH:/var/lib/containers/storage/overlay/l/3VQIVDTSWZREA2U4ZHAWVA46QH:/var/lib/containers/storage/overlay/l/DDRFFKG5BYHZNHPIIND2TUE6IJ,upperdir=/var/lib/containers/storage/overlay/2eb1b52eeaba6df4d8bc186347fb5266eb3230701369be93ec2474639598d4fd/diff,workdir=/var/lib/containers/storage/overlay/2eb1b52eeaba6df4d8bc186347fb5266eb3230701369be93ec2474639598d4fd/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6880cd3b17ee304c368f7d9d5c817224da1ab7bfd2db0abca27938edcc5384ca/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/6880cd3b17ee304c368f7d9d5c817224da1ab7bfd2db0abca27938edcc5384ca/diff,workdir=/var/lib/containers/storage/overlay/6880cd3b17ee304c368f7d9d5c817224da1ab7bfd2db0abca27938edcc5384ca/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/eb61e47f32d4a1e9158a4c4b7a717ccf8373eb71c74f08bef0a9db0e1e1837ec/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/eb61e47f32d4a1e9158a4c4b7a717ccf8373eb71c74f08bef0a9db0e1e1837ec/diff,workdir=/var/lib/containers/storage/overlay/eb61e47f32d4a1e9158a4c4b7a717ccf8373eb71c74f08bef0a9db0e1e1837ec/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/277a07a7fd855865ae42b8565a8be5a848d5f329c45d905d48f0df6e415a0a1d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/277a07a7fd855865ae42b8565a8be5a848d5f329c45d905d48f0df6e415a0a1d/diff,workdir=/var/lib/containers/storage/overlay/277a07a7fd855865ae42b8565a8be5a848d5f329c45d905d48f0df6e415a0a1d/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b7babac37b3f69bfe5a2c9d0248a7ea818baa33043f42663dba9c35723eb5cd9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/b7babac37b3f69bfe5a2c9d0248a7ea818baa33043f42663dba9c35723eb5cd9/diff,workdir=/var/lib/containers/storage/overlay/b7babac37b3f69bfe5a2c9d0248a7ea818baa33043f42663dba9c35723eb5cd9/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8bb6b02d9f54f375fc51dd051d5fa2dcb02d1b151c38021affa03677f6590a52/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/8bb6b02d9f54f375fc51dd051d5fa2dcb02d1b151c38021affa03677f6590a52/diff,workdir=/var/lib/containers/storage/overlay/8bb6b02d9f54f375fc51dd051d5fa2dcb02d1b151c38021affa03677f6590a52/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/26e88da540694d9f3583efbaa2640500abc96c4a78c7c7b8b37706c5c50e10d0/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/EIZXKTXLSF6Y3DKCICMAKINUTZ:/var/lib/containers/storage/overlay/l/B23G26Z4RKGJPIKLJP3QJMEI5L,upperdir=/var/lib/containers/storage/overlay/26e88da540694d9f3583efbaa2640500abc96c4a78c7c7b8b37706c5c50e10d0/diff,workdir=/var/lib/containers/storage/overlay/26e88da540694d9f3583efbaa2640500abc96c4a78c7c7b8b37706c5c50e10d0/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=26087788k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2026-02-20T02:52:10.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:52:10.733 DEBUG:teuthology.orchestra.run.trial098:> ip netns list 2026-02-20T02:52:10.789 INFO:teuthology.orchestra.run.trial098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2026-02-20T02:52:10.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:52:10.790 DEBUG:teuthology.orchestra.run.trial098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T02:52:10.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T02:52:10.856 DEBUG:teuthology.orchestra.run.trial098:> sudo ip link delete ceph-brx 2026-02-20T02:52:10.951 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-20T02:52:10.969 INFO:tasks.cephadm:Teardown begin 2026-02-20T02:52:10.969 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T02:52:10.996 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T02:52:11.024 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-20T02:52:11.024 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-20T02:52:11.194 INFO:teuthology.orchestra.run.trial098.stderr:Inferring config /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/mon.trial098/config 2026-02-20T02:52:11.212 INFO:teuthology.orchestra.run.trial098.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-20T02:52:11.213 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:10 trial098 ceph-mon[38923]: pgmap v846: 129 pgs: 129 active+clean; 226 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 1.5 MiB/s wr, 154 op/s 2026-02-20T02:52:11.228 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-20T02:52:11.229 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-20T02:52:11.229 DEBUG:teuthology.orchestra.run.trial098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-20T02:52:11.246 DEBUG:teuthology.orchestra.run.trial106:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-20T02:52:11.264 INFO:tasks.cephadm:Stopping all daemons... 2026-02-20T02:52:11.264 INFO:tasks.cephadm.mon.trial098:Stopping mon.trial098... 2026-02-20T02:52:11.265 DEBUG:teuthology.orchestra.run.trial098:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial098 2026-02-20T02:52:11.367 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:10 trial106 ceph-mon[44052]: pgmap v846: 129 pgs: 129 active+clean; 226 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 1.5 MiB/s wr, 154 op/s 2026-02-20T02:52:11.554 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:11 trial098 systemd[1]: Stopping Ceph mon.trial098 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:11.554 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:11 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098[38919]: 2026-02-20T02:52:11.389+0000 7fb81e368640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:11.554 INFO:journalctl@ceph.mon.trial098.trial098.stdout:Feb 20 02:52:11 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial098[38919]: 2026-02-20T02:52:11.389+0000 7fb81e368640 -1 mon.trial098@0(leader) e2 *** Got Signal Terminated *** 2026-02-20T02:52:11.646 DEBUG:teuthology.orchestra.run.trial098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial098.service' 2026-02-20T02:52:11.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:11.685 INFO:tasks.cephadm.mon.trial098:Stopped mon.trial098 2026-02-20T02:52:11.685 INFO:tasks.cephadm.mon.trial106:Stopping mon.trial106... 2026-02-20T02:52:11.686 DEBUG:teuthology.orchestra.run.trial106:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial106 2026-02-20T02:52:12.039 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:11 trial106 systemd[1]: Stopping Ceph mon.trial106 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:12.039 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:11 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial106[44048]: 2026-02-20T02:52:11.783+0000 7f7769c45640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial106 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:12.039 INFO:journalctl@ceph.mon.trial106.trial106.stdout:Feb 20 02:52:11 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-mon-trial106[44048]: 2026-02-20T02:52:11.783+0000 7f7769c45640 -1 mon.trial106@1(peon) e2 *** Got Signal Terminated *** 2026-02-20T02:52:12.127 DEBUG:teuthology.orchestra.run.trial106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@mon.trial106.service' 2026-02-20T02:52:12.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:12.165 INFO:tasks.cephadm.mon.trial106:Stopped mon.trial106 2026-02-20T02:52:12.165 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-20T02:52:12.165 DEBUG:teuthology.orchestra.run.trial098:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.0 2026-02-20T02:52:12.565 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:12 trial098 systemd[1]: Stopping Ceph osd.0 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:12.565 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:12 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0[57082]: 2026-02-20T02:52:12.261+0000 7f2917895640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:12.565 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:12 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0[57082]: 2026-02-20T02:52:12.261+0000 7f2917895640 -1 osd.0 60 *** Got signal Terminated *** 2026-02-20T02:52:12.565 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:12 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0[57082]: 2026-02-20T02:52:12.261+0000 7f2917895640 -1 osd.0 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T02:52:18.065 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:17 trial098 podman[98236]: 2026-02-20 02:52:17.777539417 +0000 UTC m=+5.528428003 container died 7f54c7acc5949e29290afe4a0cc925f8f357c1f0d088902573df8f89930467b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T02:52:18.065 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:17 trial098 podman[98236]: 2026-02-20 02:52:17.789089208 +0000 UTC m=+5.539977804 container remove 7f54c7acc5949e29290afe4a0cc925f8f357c1f0d088902573df8f89930467b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T02:52:18.065 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:17 trial098 bash[98236]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0 2026-02-20T02:52:18.065 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:17 trial098 podman[98370]: 2026-02-20 02:52:17.920637294 +0000 UTC m=+0.015937968 container create 301205f055b33b11472c41a4329b1a53005f08c959ba43311a9ca73e0a0eb896 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T02:52:18.066 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:17 trial098 podman[98370]: 2026-02-20 02:52:17.950325287 +0000 UTC m=+0.045625891 container init 301205f055b33b11472c41a4329b1a53005f08c959ba43311a9ca73e0a0eb896 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T02:52:18.066 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:17 trial098 podman[98370]: 2026-02-20 02:52:17.95291256 +0000 UTC m=+0.048213164 container start 301205f055b33b11472c41a4329b1a53005f08c959ba43311a9ca73e0a0eb896 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T02:52:18.066 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:17 trial098 podman[98370]: 2026-02-20 02:52:17.953547559 +0000 UTC m=+0.048848163 container attach 301205f055b33b11472c41a4329b1a53005f08c959ba43311a9ca73e0a0eb896 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T02:52:18.066 INFO:journalctl@ceph.osd.0.trial098.stdout:Feb 20 02:52:18 trial098 podman[98370]: 2026-02-20 02:52:17.913888326 +0000 UTC m=+0.009188930 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T02:52:18.100 DEBUG:teuthology.orchestra.run.trial098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.0.service' 2026-02-20T02:52:18.139 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:18.139 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-20T02:52:18.139 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-20T02:52:18.139 DEBUG:teuthology.orchestra.run.trial098:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.1 2026-02-20T02:52:18.564 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:18 trial098 systemd[1]: Stopping Ceph osd.1 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:18.565 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:18 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1[63660]: 2026-02-20T02:52:18.275+0000 7f6d7e137640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:18.565 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:18 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1[63660]: 2026-02-20T02:52:18.275+0000 7f6d7e137640 -1 osd.1 60 *** Got signal Terminated *** 2026-02-20T02:52:18.565 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:18 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1[63660]: 2026-02-20T02:52:18.275+0000 7f6d7e137640 -1 osd.1 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T02:52:24.214 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:23 trial098 podman[98507]: 2026-02-20 02:52:23.892382663 +0000 UTC m=+5.629434161 container died df3b659e85ac9669729ae1486f3266f140b9ca85e97d2be6a73a57a696dad01e (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-02-20T02:52:24.215 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:23 trial098 podman[98507]: 2026-02-20 02:52:23.901354138 +0000 UTC m=+5.638405636 container remove df3b659e85ac9669729ae1486f3266f140b9ca85e97d2be6a73a57a696dad01e (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7) 2026-02-20T02:52:24.215 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:23 trial098 bash[98507]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1 2026-02-20T02:52:24.215 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:24 trial098 podman[98640]: 2026-02-20 02:52:24.04318892 +0000 UTC m=+0.018719813 container create e093e678ef7674a1d0928936c66ff33a6b62d0c44dff74293806a41033a624bf (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS) 2026-02-20T02:52:24.215 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:24 trial098 podman[98640]: 2026-02-20 02:52:24.078121049 +0000 UTC m=+0.053651921 container init e093e678ef7674a1d0928936c66ff33a6b62d0c44dff74293806a41033a624bf (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default) 2026-02-20T02:52:24.215 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:24 trial098 podman[98640]: 2026-02-20 02:52:24.081362917 +0000 UTC m=+0.056893799 container start e093e678ef7674a1d0928936c66ff33a6b62d0c44dff74293806a41033a624bf (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2) 2026-02-20T02:52:24.215 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:24 trial098 podman[98640]: 2026-02-20 02:52:24.081851524 +0000 UTC m=+0.057382406 container attach e093e678ef7674a1d0928936c66ff33a6b62d0c44dff74293806a41033a624bf (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=default, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-20T02:52:24.216 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:24 trial098 podman[98640]: 2026-02-20 02:52:24.036101634 +0000 UTC m=+0.011632506 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T02:52:24.216 INFO:journalctl@ceph.osd.1.trial098.stdout:Feb 20 02:52:24 trial098 podman[98640]: 2026-02-20 02:52:24.213631621 +0000 UTC m=+0.189162493 container died e093e678ef7674a1d0928936c66ff33a6b62d0c44dff74293806a41033a624bf (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216) 2026-02-20T02:52:24.255 DEBUG:teuthology.orchestra.run.trial098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.1.service' 2026-02-20T02:52:24.294 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:24.294 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-20T02:52:24.295 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-20T02:52:24.295 DEBUG:teuthology.orchestra.run.trial098:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.2 2026-02-20T02:52:24.513 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:24 trial098 systemd[1]: Stopping Ceph osd.2 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:24.514 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:24 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2[70226]: 2026-02-20T02:52:24.428+0000 7f5e2a132640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:24.514 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:24 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2[70226]: 2026-02-20T02:52:24.428+0000 7f5e2a132640 -1 osd.2 60 *** Got signal Terminated *** 2026-02-20T02:52:24.514 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:24 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2[70226]: 2026-02-20T02:52:24.428+0000 7f5e2a132640 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T02:52:30.242 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:29 trial098 podman[98775]: 2026-02-20 02:52:29.933552651 +0000 UTC m=+5.516388372 container died f8611f6ac8a0b0f96bf99e3daf2dbc70e699f2ad5cbc465c46ebeba7ff6bb5ca (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T02:52:30.242 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:29 trial098 podman[98775]: 2026-02-20 02:52:29.942851844 +0000 UTC m=+5.525687565 container remove f8611f6ac8a0b0f96bf99e3daf2dbc70e699f2ad5cbc465c46ebeba7ff6bb5ca (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=default) 2026-02-20T02:52:30.242 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:29 trial098 bash[98775]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2 2026-02-20T02:52:30.242 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:30 trial098 podman[98918]: 2026-02-20 02:52:30.081233858 +0000 UTC m=+0.016876851 container create 584dba4a8bd86101db46a34e5d2c1f3a3a705f89d448e3869dd3f2879fdd1ab9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2-deactivate, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T02:52:30.242 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:30 trial098 podman[98918]: 2026-02-20 02:52:30.115071354 +0000 UTC m=+0.050714457 container init 584dba4a8bd86101db46a34e5d2c1f3a3a705f89d448e3869dd3f2879fdd1ab9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T02:52:30.242 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:30 trial098 podman[98918]: 2026-02-20 02:52:30.117496135 +0000 UTC m=+0.053139078 container start 584dba4a8bd86101db46a34e5d2c1f3a3a705f89d448e3869dd3f2879fdd1ab9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T02:52:30.242 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:30 trial098 podman[98918]: 2026-02-20 02:52:30.11803735 +0000 UTC m=+0.053680283 container attach 584dba4a8bd86101db46a34e5d2c1f3a3a705f89d448e3869dd3f2879fdd1ab9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2-deactivate, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216) 2026-02-20T02:52:30.243 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:30 trial098 podman[98918]: 2026-02-20 02:52:30.074784405 +0000 UTC m=+0.010427338 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T02:52:30.243 INFO:journalctl@ceph.osd.2.trial098.stdout:Feb 20 02:52:30 trial098 podman[98918]: 2026-02-20 02:52:30.240818551 +0000 UTC m=+0.176461494 container died 584dba4a8bd86101db46a34e5d2c1f3a3a705f89d448e3869dd3f2879fdd1ab9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, ceph=True, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T02:52:30.281 DEBUG:teuthology.orchestra.run.trial098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.2.service' 2026-02-20T02:52:30.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:30.319 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-20T02:52:30.319 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-20T02:52:30.319 DEBUG:teuthology.orchestra.run.trial098:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.3 2026-02-20T02:52:30.564 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:30 trial098 systemd[1]: Stopping Ceph osd.3 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:30.564 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:30 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3[76054]: 2026-02-20T02:52:30.452+0000 7fc509069640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:30.565 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:30 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3[76054]: 2026-02-20T02:52:30.452+0000 7fc509069640 -1 osd.3 60 *** Got signal Terminated *** 2026-02-20T02:52:30.565 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:30 trial098 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3[76054]: 2026-02-20T02:52:30.452+0000 7fc509069640 -1 osd.3 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T02:52:36.276 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:35 trial098 podman[99052]: 2026-02-20 02:52:35.9785526 +0000 UTC m=+5.536759920 container died b1d99526bd2290b81a50b5591a675f7977a9d38180ca3c5cbcdf40b254af1a11 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7) 2026-02-20T02:52:36.276 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:35 trial098 podman[99052]: 2026-02-20 02:52:35.988711158 +0000 UTC m=+5.546918478 container remove b1d99526bd2290b81a50b5591a675f7977a9d38180ca3c5cbcdf40b254af1a11 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T02:52:36.276 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:35 trial098 bash[99052]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3 2026-02-20T02:52:36.277 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:36 trial098 podman[99192]: 2026-02-20 02:52:36.118989197 +0000 UTC m=+0.017842805 container create 5e06fee69b03d91fdc860868bc9892c9f398b02397eb035d66ef93d389298f40 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T02:52:36.277 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:36 trial098 podman[99192]: 2026-02-20 02:52:36.154065122 +0000 UTC m=+0.052918740 container init 5e06fee69b03d91fdc860868bc9892c9f398b02397eb035d66ef93d389298f40 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3-deactivate, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T02:52:36.277 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:36 trial098 podman[99192]: 2026-02-20 02:52:36.156777116 +0000 UTC m=+0.055630714 container start 5e06fee69b03d91fdc860868bc9892c9f398b02397eb035d66ef93d389298f40 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3-deactivate, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0) 2026-02-20T02:52:36.277 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:36 trial098 podman[99192]: 2026-02-20 02:52:36.157254352 +0000 UTC m=+0.056107960 container attach 5e06fee69b03d91fdc860868bc9892c9f398b02397eb035d66ef93d389298f40 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, ceph=True, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T02:52:36.277 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:36 trial098 podman[99192]: 2026-02-20 02:52:36.111175692 +0000 UTC m=+0.010029310 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T02:52:36.277 INFO:journalctl@ceph.osd.3.trial098.stdout:Feb 20 02:52:36 trial098 podman[99192]: 2026-02-20 02:52:36.274979618 +0000 UTC m=+0.173833226 container died 5e06fee69b03d91fdc860868bc9892c9f398b02397eb035d66ef93d389298f40 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default) 2026-02-20T02:52:36.309 DEBUG:teuthology.orchestra.run.trial098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.3.service' 2026-02-20T02:52:36.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:36.347 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-20T02:52:36.347 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-20T02:52:36.348 DEBUG:teuthology.orchestra.run.trial106:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.4 2026-02-20T02:52:36.744 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:36 trial106 systemd[1]: Stopping Ceph osd.4 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:36.745 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:36 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:52:36.443+0000 7fd29b779640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:36.745 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:36 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:52:36.443+0000 7fd29b779640 -1 osd.4 60 *** Got signal Terminated *** 2026-02-20T02:52:36.745 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:36 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:52:36.443+0000 7fd29b779640 -1 osd.4 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T02:52:39.367 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:39 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:52:39.082+0000 7fd293d8a640 -1 osd.4 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:12.487300+0000 front 2026-02-20T02:52:12.487266+0000 (oldest deadline 2026-02-20T02:52:38.387258+0000) 2026-02-20T02:52:40.367 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:40 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:52:40.092+0000 7fd293d8a640 -1 osd.4 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:12.487300+0000 front 2026-02-20T02:52:12.487266+0000 (oldest deadline 2026-02-20T02:52:38.387258+0000) 2026-02-20T02:52:40.368 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:40 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:40.165+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:15.491611+0000 front 2026-02-20T02:52:15.491633+0000 (oldest deadline 2026-02-20T02:52:39.591714+0000) 2026-02-20T02:52:41.367 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:41 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4[49871]: 2026-02-20T02:52:41.072+0000 7fd293d8a640 -1 osd.4 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:12.487300+0000 front 2026-02-20T02:52:12.487266+0000 (oldest deadline 2026-02-20T02:52:38.387258+0000) 2026-02-20T02:52:41.368 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:41 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:41.132+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:15.491611+0000 front 2026-02-20T02:52:15.491633+0000 (oldest deadline 2026-02-20T02:52:39.591714+0000) 2026-02-20T02:52:41.368 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:41 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:41.227+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:41.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:41 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:41.499+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:42.172 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:41 trial106 podman[79360]: 2026-02-20 02:52:41.897204305 +0000 UTC m=+5.466026492 container died 914fd2838bb2a67c39ef165fa7ed4c5519d2ffb5b348775aa5deca6f46657135 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T02:52:42.172 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:41 trial106 podman[79360]: 2026-02-20 02:52:41.907830898 +0000 UTC m=+5.476653095 container remove 914fd2838bb2a67c39ef165fa7ed4c5519d2ffb5b348775aa5deca6f46657135 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0) 2026-02-20T02:52:42.172 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:41 trial106 bash[79360]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4 2026-02-20T02:52:42.172 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:42 trial106 podman[79492]: 2026-02-20 02:52:42.081179196 +0000 UTC m=+0.021979753 container create 5741fa085dc2eb974af7692e0910a057dd67d77618cd550a60bd807a25c43fd4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.license=GPLv2) 2026-02-20T02:52:42.172 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:42 trial106 podman[79492]: 2026-02-20 02:52:42.121392101 +0000 UTC m=+0.062192668 container init 5741fa085dc2eb974af7692e0910a057dd67d77618cd550a60bd807a25c43fd4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, org.label-schema.license=GPLv2) 2026-02-20T02:52:42.172 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:42 trial106 podman[79492]: 2026-02-20 02:52:42.123815065 +0000 UTC m=+0.064615632 container start 5741fa085dc2eb974af7692e0910a057dd67d77618cd550a60bd807a25c43fd4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4-deactivate, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T02:52:42.172 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:42 trial106 podman[79492]: 2026-02-20 02:52:42.124352492 +0000 UTC m=+0.065153059 container attach 5741fa085dc2eb974af7692e0910a057dd67d77618cd550a60bd807a25c43fd4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-4-deactivate, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS) 2026-02-20T02:52:42.173 INFO:journalctl@ceph.osd.4.trial106.stdout:Feb 20 02:52:42 trial106 podman[79492]: 2026-02-20 02:52:42.073290313 +0000 UTC m=+0.014090890 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T02:52:42.307 DEBUG:teuthology.orchestra.run.trial106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.4.service' 2026-02-20T02:52:42.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:42.344 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-20T02:52:42.344 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-20T02:52:42.344 DEBUG:teuthology.orchestra.run.trial106:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.5 2026-02-20T02:52:42.423 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:42 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:42.169+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:15.491611+0000 front 2026-02-20T02:52:15.491633+0000 (oldest deadline 2026-02-20T02:52:39.591714+0000) 2026-02-20T02:52:42.423 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:42 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:42.219+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:42.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:42 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:42.457+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:42.868 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:42 trial106 systemd[1]: Stopping Ceph osd.5 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:42.868 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:42 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:42.482+0000 7fb18bb39640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:42.868 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:42 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:42.482+0000 7fb18bb39640 -1 osd.5 60 *** Got signal Terminated *** 2026-02-20T02:52:42.868 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:42 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:42.482+0000 7fb18bb39640 -1 osd.5 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T02:52:43.421 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:43 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:43.128+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:15.491611+0000 front 2026-02-20T02:52:15.491633+0000 (oldest deadline 2026-02-20T02:52:39.591714+0000) 2026-02-20T02:52:43.421 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:43 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:43.251+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:43.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:43 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:43.419+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:44.448 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:44 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:44.143+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:15.491611+0000 front 2026-02-20T02:52:15.491633+0000 (oldest deadline 2026-02-20T02:52:39.591714+0000) 2026-02-20T02:52:44.448 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:44 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:44.288+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:44.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:44 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:44.445+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:45.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:45 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:45.416+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:45.618 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:45 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:45.166+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:15.491611+0000 front 2026-02-20T02:52:15.491633+0000 (oldest deadline 2026-02-20T02:52:39.591714+0000) 2026-02-20T02:52:45.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:45 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:45.282+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:46.617 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:46 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:46.183+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:15.491611+0000 front 2026-02-20T02:52:15.491633+0000 (oldest deadline 2026-02-20T02:52:39.591714+0000) 2026-02-20T02:52:46.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:46 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:46.312+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:46.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:46 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:46.312+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.948596+0000 front 2026-02-20T02:52:20.948674+0000 (oldest deadline 2026-02-20T02:52:45.648575+0000) 2026-02-20T02:52:46.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:46 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:46.408+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:46.619 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:46 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:46.408+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:47.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:47 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:47.413+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:47.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:47 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:47.413+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:47.617 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:47 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:47.179+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:15.491611+0000 front 2026-02-20T02:52:15.491633+0000 (oldest deadline 2026-02-20T02:52:39.591714+0000) 2026-02-20T02:52:47.617 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:47 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5[55314]: 2026-02-20T02:52:47.179+0000 7fb188152640 -1 osd.5 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:22.992490+0000 front 2026-02-20T02:52:22.992508+0000 (oldest deadline 2026-02-20T02:52:47.092591+0000) 2026-02-20T02:52:47.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:47 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:47.329+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:47.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:47 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:47.329+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.948596+0000 front 2026-02-20T02:52:20.948674+0000 (oldest deadline 2026-02-20T02:52:45.648575+0000) 2026-02-20T02:52:48.179 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:47 trial106 podman[79633]: 2026-02-20 02:52:47.867045102 +0000 UTC m=+5.396806622 container died 2e33f8db853b985e1e7ae860ab6af619bcc38e7d6e10a9a3634df46ef0789183 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T02:52:48.180 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:47 trial106 podman[79633]: 2026-02-20 02:52:47.876768796 +0000 UTC m=+5.406530326 container remove 2e33f8db853b985e1e7ae860ab6af619bcc38e7d6e10a9a3634df46ef0789183 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T02:52:48.180 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:47 trial106 bash[79633]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5 2026-02-20T02:52:48.180 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:48 trial106 podman[79768]: 2026-02-20 02:52:48.015114331 +0000 UTC m=+0.015326568 container create c83d14a93e1b83291c0cebb8f8b48b24d4cba3c4d226861d92b33d5f4fc172b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5-deactivate, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default) 2026-02-20T02:52:48.180 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:48 trial106 podman[79768]: 2026-02-20 02:52:48.043864851 +0000 UTC m=+0.044077098 container init c83d14a93e1b83291c0cebb8f8b48b24d4cba3c4d226861d92b33d5f4fc172b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20260216) 2026-02-20T02:52:48.180 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:48 trial106 podman[79768]: 2026-02-20 02:52:48.046328105 +0000 UTC m=+0.046540342 container start c83d14a93e1b83291c0cebb8f8b48b24d4cba3c4d226861d92b33d5f4fc172b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-02-20T02:52:48.180 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:48 trial106 podman[79768]: 2026-02-20 02:52:48.046837701 +0000 UTC m=+0.047049948 container attach c83d14a93e1b83291c0cebb8f8b48b24d4cba3c4d226861d92b33d5f4fc172b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5-deactivate, ceph=True, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T02:52:48.180 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:48 trial106 podman[79768]: 2026-02-20 02:52:48.008788596 +0000 UTC m=+0.009000823 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T02:52:48.180 INFO:journalctl@ceph.osd.5.trial106.stdout:Feb 20 02:52:48 trial106 podman[79768]: 2026-02-20 02:52:48.178355679 +0000 UTC m=+0.178567926 container died c83d14a93e1b83291c0cebb8f8b48b24d4cba3c4d226861d92b33d5f4fc172b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T02:52:48.210 DEBUG:teuthology.orchestra.run.trial106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.5.service' 2026-02-20T02:52:48.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:48.288 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-20T02:52:48.288 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-20T02:52:48.288 DEBUG:teuthology.orchestra.run.trial106:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.6 2026-02-20T02:52:48.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:48.404+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:48.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:48.404+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:48.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:48.287+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:48.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:48.287+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.948596+0000 front 2026-02-20T02:52:20.948674+0000 (oldest deadline 2026-02-20T02:52:45.648575+0000) 2026-02-20T02:52:48.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:48 trial106 systemd[1]: Stopping Ceph osd.6 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:48.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:48.423+0000 7fc1349f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:48.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:48.423+0000 7fc1349f8640 -1 osd.6 60 *** Got signal Terminated *** 2026-02-20T02:52:48.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:48 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:48.423+0000 7fc1349f8640 -1 osd.6 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T02:52:49.617 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:49 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:49.287+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:49.617 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:49 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:49.287+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.948596+0000 front 2026-02-20T02:52:20.948674+0000 (oldest deadline 2026-02-20T02:52:45.648575+0000) 2026-02-20T02:52:49.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:49 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:49.373+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:49.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:49 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:49.373+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:50.617 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:50 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:50.282+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:50.617 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:50 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:50.282+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.948596+0000 front 2026-02-20T02:52:20.948674+0000 (oldest deadline 2026-02-20T02:52:45.648575+0000) 2026-02-20T02:52:50.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:50 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:50.407+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:50.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:50 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:50.407+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:51.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:51 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:51.378+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:51.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:51 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:51.378+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:51.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:51 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:51.255+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:51.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:51 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:51.255+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.948596+0000 front 2026-02-20T02:52:20.948674+0000 (oldest deadline 2026-02-20T02:52:45.648575+0000) 2026-02-20T02:52:51.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:51 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:51.255+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:25.648773+0000 front 2026-02-20T02:52:25.648815+0000 (oldest deadline 2026-02-20T02:52:50.348825+0000) 2026-02-20T02:52:52.412 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:52 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:52.258+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:52.412 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:52 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:52.258+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.948596+0000 front 2026-02-20T02:52:20.948674+0000 (oldest deadline 2026-02-20T02:52:45.648575+0000) 2026-02-20T02:52:52.412 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:52 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:52.258+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:25.648773+0000 front 2026-02-20T02:52:25.648815+0000 (oldest deadline 2026-02-20T02:52:50.348825+0000) 2026-02-20T02:52:52.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:52 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:52.411+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:52.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:52 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:52.411+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:52.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:52 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:52.411+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:27.351408+0000 front 2026-02-20T02:52:27.351538+0000 (oldest deadline 2026-02-20T02:52:52.051436+0000) 2026-02-20T02:52:53.617 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:53 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:53.296+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.848271+0000 front 2026-02-20T02:52:16.848336+0000 (oldest deadline 2026-02-20T02:52:40.948358+0000) 2026-02-20T02:52:53.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:53 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:53.296+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.948596+0000 front 2026-02-20T02:52:20.948674+0000 (oldest deadline 2026-02-20T02:52:45.648575+0000) 2026-02-20T02:52:53.618 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:53 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6[60854]: 2026-02-20T02:52:53.296+0000 7fc131011640 -1 osd.6 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:25.648773+0000 front 2026-02-20T02:52:25.648815+0000 (oldest deadline 2026-02-20T02:52:50.348825+0000) 2026-02-20T02:52:53.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:53 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:53.396+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:53.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:53 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:53.396+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:53.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:53 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:53.396+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:27.351408+0000 front 2026-02-20T02:52:27.351538+0000 (oldest deadline 2026-02-20T02:52:52.051436+0000) 2026-02-20T02:52:54.181 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:53 trial106 podman[79904]: 2026-02-20 02:52:53.929008505 +0000 UTC m=+5.517412551 container died adc71ac0d4f0858615df20c11767db2e8d56c006eedb1d5591bbb32808bc99d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6, ceph=True, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T02:52:54.181 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:53 trial106 podman[79904]: 2026-02-20 02:52:53.940635608 +0000 UTC m=+5.529039654 container remove adc71ac0d4f0858615df20c11767db2e8d56c006eedb1d5591bbb32808bc99d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T02:52:54.181 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:53 trial106 bash[79904]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6 2026-02-20T02:52:54.181 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:54 trial106 podman[80041]: 2026-02-20 02:52:54.0884852 +0000 UTC m=+0.015823049 container create 3508c0485b22eda948e8d14fb62ef53a64a4e7cc6003220654f1525f11d1ad99 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2026-02-20T02:52:54.182 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:54 trial106 podman[80041]: 2026-02-20 02:52:54.118787193 +0000 UTC m=+0.046124992 container init 3508c0485b22eda948e8d14fb62ef53a64a4e7cc6003220654f1525f11d1ad99 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6-deactivate, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T02:52:54.182 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:54 trial106 podman[80041]: 2026-02-20 02:52:54.121356891 +0000 UTC m=+0.048694680 container start 3508c0485b22eda948e8d14fb62ef53a64a4e7cc6003220654f1525f11d1ad99 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, OSD_FLAVOR=default, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2) 2026-02-20T02:52:54.182 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:54 trial106 podman[80041]: 2026-02-20 02:52:54.121982161 +0000 UTC m=+0.049319950 container attach 3508c0485b22eda948e8d14fb62ef53a64a4e7cc6003220654f1525f11d1ad99 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2) 2026-02-20T02:52:54.182 INFO:journalctl@ceph.osd.6.trial106.stdout:Feb 20 02:52:54 trial106 podman[80041]: 2026-02-20 02:52:54.081689451 +0000 UTC m=+0.009027240 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T02:52:54.284 DEBUG:teuthology.orchestra.run.trial106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.6.service' 2026-02-20T02:52:54.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:52:54.322 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-20T02:52:54.322 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-20T02:52:54.323 DEBUG:teuthology.orchestra.run.trial106:> sudo systemctl stop ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.7 2026-02-20T02:52:54.445 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:54 trial106 systemd[1]: Stopping Ceph osd.7 for 5138774d-0e03-11f1-8edf-d404e6e7d460... 2026-02-20T02:52:54.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:54 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:54.442+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:54.868 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:54 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:54.442+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:54.868 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:54 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:54.442+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:27.351408+0000 front 2026-02-20T02:52:27.351538+0000 (oldest deadline 2026-02-20T02:52:52.051436+0000) 2026-02-20T02:52:54.868 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:54 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:54.452+0000 7f6ad2fe8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T02:52:54.868 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:54 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:54.452+0000 7f6ad2fe8640 -1 osd.7 60 *** Got signal Terminated *** 2026-02-20T02:52:54.868 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:54 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:54.452+0000 7f6ad2fe8640 -1 osd.7 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T02:52:55.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:55 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:55.415+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:55.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:55 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:55.415+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:55.867 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:55 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:55.415+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:27.351408+0000 front 2026-02-20T02:52:27.351538+0000 (oldest deadline 2026-02-20T02:52:52.051436+0000) 2026-02-20T02:52:56.745 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:56 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:56.397+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:56.745 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:56 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:56.397+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:56.745 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:56 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:56.397+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:27.351408+0000 front 2026-02-20T02:52:27.351538+0000 (oldest deadline 2026-02-20T02:52:52.051436+0000) 2026-02-20T02:52:57.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:57 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:57.361+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:57.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:57 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:57.361+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:57.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:57 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:57.361+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:27.351408+0000 front 2026-02-20T02:52:27.351538+0000 (oldest deadline 2026-02-20T02:52:52.051436+0000) 2026-02-20T02:52:58.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:58 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:58.318+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:58.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:58 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:58.318+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:58.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:58 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:58.318+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:27.351408+0000 front 2026-02-20T02:52:27.351538+0000 (oldest deadline 2026-02-20T02:52:52.051436+0000) 2026-02-20T02:52:59.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:59 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:59.295+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6806 osd.0 since back 2026-02-20T02:52:16.250669+0000 front 2026-02-20T02:52:16.250611+0000 (oldest deadline 2026-02-20T02:52:40.950682+0000) 2026-02-20T02:52:59.617 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:59 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:59.295+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6814 osd.1 since back 2026-02-20T02:52:20.950857+0000 front 2026-02-20T02:52:20.950944+0000 (oldest deadline 2026-02-20T02:52:45.650913+0000) 2026-02-20T02:52:59.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:59 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:59.295+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6822 osd.2 since back 2026-02-20T02:52:27.351408+0000 front 2026-02-20T02:52:27.351538+0000 (oldest deadline 2026-02-20T02:52:52.051436+0000) 2026-02-20T02:52:59.618 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:52:59 trial106 ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7[66139]: 2026-02-20T02:52:59.295+0000 7f6acf601640 -1 osd.7 60 heartbeat_check: no reply from 10.20.193.98:6830 osd.3 since back 2026-02-20T02:52:34.252251+0000 front 2026-02-20T02:52:34.252180+0000 (oldest deadline 2026-02-20T02:52:58.952203+0000) 2026-02-20T02:53:00.359 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 podman[80174]: 2026-02-20 02:53:00.059606821 +0000 UTC m=+5.618998708 container died 37b6f36e46747fa5c2f495eca79da6ea86b4b8fdf46f3890409139db558bb325 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T02:53:00.360 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 podman[80174]: 2026-02-20 02:53:00.069941206 +0000 UTC m=+5.629333093 container remove 37b6f36e46747fa5c2f495eca79da6ea86b4b8fdf46f3890409139db558bb325 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default) 2026-02-20T02:53:00.360 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 bash[80174]: ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7 2026-02-20T02:53:00.360 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 podman[80306]: 2026-02-20 02:53:00.198255913 +0000 UTC m=+0.016309232 container create 55e465788363416f0c5969323030f94ac3cf16db66dc04b03ce392e63e318e60 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.license=GPLv2, ceph=True, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T02:53:00.360 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 podman[80306]: 2026-02-20 02:53:00.228376599 +0000 UTC m=+0.046429918 container init 55e465788363416f0c5969323030f94ac3cf16db66dc04b03ce392e63e318e60 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7-deactivate, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-02-20T02:53:00.360 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 podman[80306]: 2026-02-20 02:53:00.231035442 +0000 UTC m=+0.049088771 container start 55e465788363416f0c5969323030f94ac3cf16db66dc04b03ce392e63e318e60 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7-deactivate, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T02:53:00.360 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 podman[80306]: 2026-02-20 02:53:00.231727626 +0000 UTC m=+0.049780945 container attach 55e465788363416f0c5969323030f94ac3cf16db66dc04b03ce392e63e318e60 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T02:53:00.360 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 podman[80306]: 2026-02-20 02:53:00.191716419 +0000 UTC m=+0.009769738 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T02:53:00.360 INFO:journalctl@ceph.osd.7.trial106.stdout:Feb 20 02:53:00 trial106 podman[80306]: 2026-02-20 02:53:00.358528194 +0000 UTC m=+0.176581513 container died 55e465788363416f0c5969323030f94ac3cf16db66dc04b03ce392e63e318e60 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-5138774d-0e03-11f1-8edf-d404e6e7d460-osd-7-deactivate, org.label-schema.license=GPLv2, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T02:53:00.389 DEBUG:teuthology.orchestra.run.trial106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5138774d-0e03-11f1-8edf-d404e6e7d460@osd.7.service' 2026-02-20T02:53:00.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T02:53:00.426 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-20T02:53:00.427 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 --force --keep-logs 2026-02-20T02:53:00.544 INFO:teuthology.orchestra.run.trial098.stdout:Deleting cluster with fsid: 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:53:10.405 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 --force --keep-logs 2026-02-20T02:53:10.519 INFO:teuthology.orchestra.run.trial106.stdout:Deleting cluster with fsid: 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T02:53:17.405 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T02:53:17.435 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T02:53:17.461 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-20T02:53:17.465 DEBUG:teuthology.misc:Transferring archived files from trial098:/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394/remote/trial098/crash 2026-02-20T02:53:17.466 DEBUG:teuthology.orchestra.run.trial098:> sudo tar c -f - -C /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/crash -- . 2026-02-20T02:53:17.502 INFO:teuthology.orchestra.run.trial098.stderr:tar: /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-20T02:53:17.502 INFO:teuthology.orchestra.run.trial098.stderr:tar: Error is not recoverable: exiting now 2026-02-20T02:53:17.504 DEBUG:teuthology.misc:Transferring archived files from trial106:/var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394/remote/trial106/crash 2026-02-20T02:53:17.505 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/crash -- . 2026-02-20T02:53:17.530 INFO:teuthology.orchestra.run.trial106.stderr:tar: /var/lib/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-20T02:53:17.531 INFO:teuthology.orchestra.run.trial106.stderr:tar: Error is not recoverable: exiting now 2026-02-20T02:53:17.532 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-20T02:53:17.532 DEBUG:teuthology.orchestra.run.trial098:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-20T02:53:17.571 INFO:teuthology.orchestra.run.trial098.stdout:2026-02-20T02:26:02.961531+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 91875.290441 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-20T02:53:17.571 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-20T02:53:17.572 DEBUG:teuthology.orchestra.run.trial098:> sudo egrep '\[SEC\]' /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-20T02:53:17.638 DEBUG:teuthology.orchestra.run.trial098:> sudo egrep '\[ERR\]' /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-20T02:53:17.705 DEBUG:teuthology.orchestra.run.trial098:> sudo egrep '\[WRN\]' /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-20T02:53:17.771 INFO:teuthology.orchestra.run.trial098.stdout:2026-02-20T02:26:02.961531+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 91875.290441 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-20T02:53:17.771 INFO:tasks.cephadm:Compressing logs... 2026-02-20T02:53:17.771 DEBUG:teuthology.orchestra.run.trial098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T02:53:17.814 DEBUG:teuthology.orchestra.run.trial106:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T02:53:17.834 INFO:teuthology.orchestra.run.trial098.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-20T02:53:17.835 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-20T02:53:17.835 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2026-02-20T02:53:17.839 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.2.log 2026-02-20T02:53:17.839 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.0.log 2026-02-20T02:53:17.839 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.3.log 2026-02-20T02:53:17.839 INFO:teuthology.orchestra.run.trial098.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2026-02-20T02:53:17.839 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.2.log: /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-client.ceph-exporter.trial098.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.cephadm.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-client.ceph-exporter.trial098.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mgr.trial098.hiicxh.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.audit.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mgr.trial098.hiicxh.log: 84.2% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.cephadm.log.gz 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-volume.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.1.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mon.trial098.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.bar.trial098.pnrgwl.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mon.trial098.log: 94.5%gzip -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-client.ceph-exporter.trial098.log.gz 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr: -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.foo.trial098.qfxvya.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.bar.trial098.pnrgwl.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log 2026-02-20T02:53:17.840 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.foo.trial098.qfxvya.log: /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log: 91.8% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.audit.log.gz 2026-02-20T02:53:17.841 INFO:teuthology.orchestra.run.trial098.stderr: 88.1% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log.gz 2026-02-20T02:53:17.845 INFO:teuthology.orchestra.run.trial106.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-20T02:53:17.845 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-20T02:53:17.845 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2026-02-20T02:53:17.845 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.5.log 2026-02-20T02:53:17.845 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.7.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.cephadm.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-client.ceph-exporter.trial106.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mon.trial106.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-client.ceph-exporter.trial106.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.4.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr: 84.1% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.cephadm.log.gz 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr: 68.2% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-client.ceph-exporter.trial106.log.gz 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mon.trial106.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.bar.trial106.thijxu.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mgr.trial106.gehstk.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.bar.trial106.thijxu.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.audit.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mgr.trial106.gehstk.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-volume.log 2026-02-20T02:53:17.846 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.6.log 2026-02-20T02:53:17.847 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.foo.trial106.alrimh.log 2026-02-20T02:53:17.847 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log 2026-02-20T02:53:17.847 INFO:teuthology.orchestra.run.trial106.stderr:/var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.foo.trial106.alrimh.log: /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log: 92.0% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.audit.log.gz 2026-02-20T02:53:17.847 INFO:teuthology.orchestra.run.trial106.stderr: 94.8% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.bar.trial106.thijxu.log.gz 2026-02-20T02:53:17.848 INFO:teuthology.orchestra.run.trial106.stderr: 88.1% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph.log.gz 2026-02-20T02:53:17.848 INFO:teuthology.orchestra.run.trial106.stderr: 93.5% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mgr.trial106.gehstk.log.gz 2026-02-20T02:53:17.848 INFO:teuthology.orchestra.run.trial098.stderr: 92.6% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.foo.trial098.qfxvya.log.gz 2026-02-20T02:53:17.848 INFO:teuthology.orchestra.run.trial098.stderr: 94.9% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-volume.log.gz 2026-02-20T02:53:17.848 INFO:teuthology.orchestra.run.trial098.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-20T02:53:17.850 INFO:teuthology.orchestra.run.trial106.stderr: 94.8% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-volume.log.gz 2026-02-20T02:53:17.870 INFO:teuthology.orchestra.run.trial106.stderr: 94.7% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.foo.trial106.alrimh.log.gz 2026-02-20T02:53:17.965 INFO:teuthology.orchestra.run.trial098.stderr: 90.9% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mgr.trial098.hiicxh.log.gz 2026-02-20T02:53:18.286 INFO:teuthology.orchestra.run.trial098.stderr: 90.2% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mon.trial098.log.gz 2026-02-20T02:53:18.535 INFO:teuthology.orchestra.run.trial106.stderr: 93.3% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mon.trial106.log.gz 2026-02-20T02:53:24.384 INFO:teuthology.orchestra.run.trial106.stderr: 94.1% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.6.log.gz 2026-02-20T02:53:24.958 INFO:teuthology.orchestra.run.trial098.stderr: 93.8% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.2.log.gz 2026-02-20T02:53:25.512 INFO:teuthology.orchestra.run.trial106.stderr: 93.8% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.7.log.gz 2026-02-20T02:53:26.774 INFO:teuthology.orchestra.run.trial098.stderr: 94.0% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.0.log.gz 2026-02-20T02:53:27.148 INFO:teuthology.orchestra.run.trial106.stderr: 93.8% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.5.log.gz 2026-02-20T02:53:27.829 INFO:teuthology.orchestra.run.trial098.stderr: 93.9% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.1.log.gz 2026-02-20T02:53:28.085 INFO:teuthology.orchestra.run.trial098.stderr: 94.2% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.3.log.gz 2026-02-20T02:53:30.967 INFO:teuthology.orchestra.run.trial106.stderr: 94.1% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-osd.4.log.gz 2026-02-20T03:02:35.741 INFO:teuthology.orchestra.run.trial098.stderr: 94.6% -- replaced with /var/log/ceph/5138774d-0e03-11f1-8edf-d404e6e7d460/ceph-mds.bar.trial098.pnrgwl.log.gz 2026-02-20T03:02:35.744 INFO:teuthology.orchestra.run.trial098.stderr: 2026-02-20T03:02:35.744 INFO:teuthology.orchestra.run.trial098.stderr:real 9m17.916s 2026-02-20T03:02:35.744 INFO:teuthology.orchestra.run.trial098.stderr:user 9m19.447s 2026-02-20T03:02:35.744 INFO:teuthology.orchestra.run.trial098.stderr:sys 0m33.308s 2026-02-20T03:03:44.973 INFO:teuthology.orchestra.run.trial106.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2026-02-20T03:03:44.976 INFO:teuthology.orchestra.run.trial106.stderr: 2026-02-20T03:03:44.976 INFO:teuthology.orchestra.run.trial106.stderr:real 10m27.144s 2026-02-20T03:03:44.976 INFO:teuthology.orchestra.run.trial106.stderr:user 10m9.423s 2026-02-20T03:03:44.976 INFO:teuthology.orchestra.run.trial106.stderr:sys 0m49.857s 2026-02-20T03:03:44.977 INFO:tasks.cephadm:Archiving logs... 2026-02-20T03:03:44.977 DEBUG:teuthology.misc:Transferring archived files from trial098:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394/remote/trial098/log 2026-02-20T03:03:44.979 DEBUG:teuthology.orchestra.run.trial098:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T03:04:23.193 DEBUG:teuthology.misc:Transferring archived files from trial106:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394/remote/trial106/log 2026-02-20T03:04:23.194 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T03:05:08.088 INFO:tasks.cephadm:Removing cluster... 2026-02-20T03:05:08.089 DEBUG:teuthology.orchestra.run.trial098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 --force 2026-02-20T03:05:08.240 INFO:teuthology.orchestra.run.trial098.stdout:Deleting cluster with fsid: 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T03:05:09.389 DEBUG:teuthology.orchestra.run.trial106:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5138774d-0e03-11f1-8edf-d404e6e7d460 --force 2026-02-20T03:05:09.539 INFO:teuthology.orchestra.run.trial106.stdout:Deleting cluster with fsid: 5138774d-0e03-11f1-8edf-d404e6e7d460 2026-02-20T03:05:09.777 INFO:tasks.cephadm:Removing cephadm ... 2026-02-20T03:05:09.777 DEBUG:teuthology.orchestra.run.trial098:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-20T03:05:09.795 DEBUG:teuthology.orchestra.run.trial106:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-20T03:05:09.811 INFO:tasks.cephadm:Teardown complete 2026-02-20T03:05:09.812 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T03:05:09.822 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T03:05:09.822 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T03:05:09.837 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T03:05:09.994 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T03:05:10.005 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T03:05:10.005 DEBUG:teuthology.orchestra.run.trial098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T03:05:10.007 DEBUG:teuthology.orchestra.run.trial106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T03:05:10.021 INFO:teuthology.orchestra.run.trial098.stderr:bash: line 1: ntpq: command not found 2026-02-20T03:05:10.024 INFO:teuthology.orchestra.run.trial106.stderr:bash: line 1: ntpq: command not found 2026-02-20T03:05:10.046 INFO:teuthology.orchestra.run.trial106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T03:05:10.046 INFO:teuthology.orchestra.run.trial106.stdout:=============================================================================== 2026-02-20T03:05:10.046 INFO:teuthology.orchestra.run.trial106.stdout:^- 44.190.5.123 2 6 377 29 +1296us[+1296us] +/- 33ms 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial106.stdout:^- 149.28.200.179.vultruser> 2 8 377 92 -319us[ -318us] +/- 40ms 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial106.stdout:^* time.cloudflare.com 3 6 377 30 +1071ns[+2704ns] +/- 6483us 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial106.stdout:^- 155.248.196.28 2 8 377 96 +228us[ +238us] +/- 49ms 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial098.stdout:=============================================================================== 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial098.stdout:^- 44.190.5.123 2 6 377 26 +1278us[+1278us] +/- 33ms 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial098.stdout:^- 149.28.200.179.vultruser> 2 8 377 97 -549us[ -427us] +/- 41ms 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial098.stdout:^* time.cloudflare.com 3 7 377 89 -44us[ +81us] +/- 6920us 2026-02-20T03:05:10.047 INFO:teuthology.orchestra.run.trial098.stdout:^- 155.248.196.28 2 8 377 92 -187us[ -62us] +/- 49ms 2026-02-20T03:05:10.048 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T03:05:10.058 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T03:05:10.058 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T03:05:10.073 DEBUG:teuthology.orchestra.run.trial098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T03:05:10.149 DEBUG:teuthology.orchestra.run.trial106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T03:05:10.209 DEBUG:teuthology.orchestra.run.trial098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T03:05:10.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:10.239 DEBUG:teuthology.orchestra.run.trial106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T03:05:10.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:10.266 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T03:05:10.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T03:05:10.299 INFO:teuthology.task.internal:Duration was 2665.641588 seconds 2026-02-20T03:05:10.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T03:05:10.317 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T03:05:10.317 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T03:05:10.320 DEBUG:teuthology.orchestra.run.trial106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T03:05:10.356 INFO:teuthology.orchestra.run.trial098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T03:05:10.358 INFO:teuthology.orchestra.run.trial106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T03:05:10.650 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T03:05:10.650 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial098.front.sepia.ceph.com 2026-02-20T03:05:10.651 DEBUG:teuthology.orchestra.run.trial098:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T03:05:10.671 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial106.front.sepia.ceph.com 2026-02-20T03:05:10.672 DEBUG:teuthology.orchestra.run.trial106:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T03:05:10.708 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T03:05:10.708 DEBUG:teuthology.orchestra.run.trial098:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:05:10.713 DEBUG:teuthology.orchestra.run.trial106:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:05:10.909 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T03:05:10.909 DEBUG:teuthology.orchestra.run.trial098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T03:05:10.910 DEBUG:teuthology.orchestra.run.trial106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T03:05:10.932 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:05:10.932 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:05:10.932 INFO:teuthology.orchestra.run.trial098.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:05:10.932 INFO:teuthology.orchestra.run.trial098.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T03:05:10.932 INFO:teuthology.orchestra.run.trial098.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T03:05:10.934 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:05:10.935 INFO:teuthology.orchestra.run.trial106.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:05:10.935 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:05:10.935 INFO:teuthology.orchestra.run.trial106.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T03:05:10.935 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T03:05:10.955 INFO:teuthology.orchestra.run.trial106.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T03:05:10.967 INFO:teuthology.orchestra.run.trial098.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T03:05:10.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T03:05:10.982 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T03:05:10.982 DEBUG:teuthology.orchestra.run.trial098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T03:05:11.033 DEBUG:teuthology.orchestra.run.trial106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T03:05:11.058 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T03:05:11.069 DEBUG:teuthology.orchestra.run.trial098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:05:11.076 DEBUG:teuthology.orchestra.run.trial106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:05:11.100 INFO:teuthology.orchestra.run.trial098.stdout:kernel.core_pattern = core 2026-02-20T03:05:11.121 INFO:teuthology.orchestra.run.trial106.stdout:kernel.core_pattern = core 2026-02-20T03:05:11.134 DEBUG:teuthology.orchestra.run.trial098:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:05:11.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:11.187 DEBUG:teuthology.orchestra.run.trial106:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:05:11.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:11.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T03:05:11.214 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T03:05:11.214 DEBUG:teuthology.misc:Transferring archived files from trial098:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394/remote/trial098 2026-02-20T03:05:11.214 DEBUG:teuthology.orchestra.run.trial098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T03:05:11.263 DEBUG:teuthology.misc:Transferring archived files from trial106:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55394/remote/trial106 2026-02-20T03:05:11.263 DEBUG:teuthology.orchestra.run.trial106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T03:05:11.294 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T03:05:11.294 DEBUG:teuthology.orchestra.run.trial098:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T03:05:11.298 DEBUG:teuthology.orchestra.run.trial106:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T03:05:11.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T03:05:11.367 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T03:05:11.367 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T03:05:11.386 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T03:05:11.386 DEBUG:teuthology.orchestra.run.trial098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T03:05:11.389 DEBUG:teuthology.orchestra.run.trial106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T03:05:11.403 INFO:teuthology.orchestra.run.trial098.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 03:05 /home/ubuntu/cephtest 2026-02-20T03:05:11.407 INFO:teuthology.orchestra.run.trial106.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 03:05 /home/ubuntu/cephtest 2026-02-20T03:05:11.408 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T03:05:11.426 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T03:05:11.469 INFO:teuthology.run:Summary data: description: fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} duration: 2665.641587972641 failure_reason: '"2026-02-20T02:26:02.961531+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 91875.290441 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_jcollin@soko04.front.sepia.ceph.com success: false 2026-02-20T03:05:11.469 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T03:05:11.583 INFO:teuthology.run:FAIL